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ABSTRACT 


<oHz_ 

. . ^  We  study  the  fundamental  properties  of  feedback  for  nonlinear, 


time-varying ,  multi-input ,  multi-output  distributed  systems.  The 
classical  Black  formula  is  generalized  to  the  nonlinear  case.  Achievable 


advantages  and  limitations  of  feedback  in  nonlinear  dynamical  systems 
are  classified  and  rtudiod  in  five-  categories:  desensitization, 
disturbance  attenuation,  linearizing  effect,  asymptotic  tracking  and 

disturbance  rejection,  stabilization.  Conditions  under  which  feedback  is 
beneficial  for  nonlinear  dynamical  systems  are  derived.  Our  results  show 
that  if  the  appropriate  linearized  inverse  return  difference  operator  is 


small,  then  the  nonlinear  feedback  system  has  advantages  over  the  open- 


loop  system.  Several  examples  are  provided  to  illustrate  the  results. 


I. 


INTRODUCTION 


Feedback  is  one  of  the  most  important  engineering  inventions. 

Historically  [1],  some  third  century  B.C  water  clocks  may  be 
viewed  as  primitive  feedback  devices.  Some  more  definite  feedback 
systems  such  as  furnace  temperature  regulators,  float  regulators, 
windmills,  etc.  were  invented  between  Lhe  L6th  and  18th  century.  However, 
it  is  only  at  the  turn  of  the  19th  century,  when  James  Watt  invented  the 
steam  engine  governor,  that  the  concept  of  feedback  began  to  be  appreciated 
and  used  by  engineers.  Attempts  to  understand  and  to  analyze  the  associ¬ 
ated  stability  problems  brought  by  feedback  were  then  made  by  several 
pioneers,  e.g.  Airy,  Maxwell,  Lyapunov,  Routh,  Hurwitz,  Vyschnegradskii,  etc. 
Up  to  the  1920's,  feedback  devices  were  predominantly  mechanical  regulators 
whose  primary  objective  was  to  reduce  the  regulated  error  to  zero.  The 
need  of  long  distance  telephony  in  the  1920 's  [2]  resulted  in  the 
crucial  invention  of  the  negative  feedback  amplifier  by  H.S.  Black  [3,4]. 
Black's  major  invention  was  to  conceive  the  benefits  of  feedback  resulting 
from  a  high  forward-path  gain:  he  fed  the  output  back  to  the  input  stage; 
he  showed  that  by  using  a  high  gain  in  the  forward  path,  one  obtains 
an  amplifier  which  is  1)  more  linear  than  the  vacuum  tubes  in  the  forward 
path,  2)  insensitive  to  variations  in  the  vacuum  tubes  in  the  forward 
path,  and  3)  insensitive  to  noise  injected  at  the  output  stage.  Depend¬ 
ing  on  the  applications,  the  requirements  on  negative  feedback  amplifier 
and  on  mechanical  regulators  may  be  quite  different.  Nevertheless, 
during  World  War  II,  the  need  of  very  accurate  servomechanisms  for 
anti-aircraft  defense  brought  them  together.  It  is  our  opinion  that 
there  is  £  unlf ied  underlying  discipline  of  feedback:  different  applica¬ 
tions  emphasize  different  aspects  of  that  discipline. 


In  practice,  feedback  is  indispensable  in  many  system  designs 
because  of  I)  uncertainties:  typically,  incomplete  knowledge  of  the  plant 
due  to  plain  ignorance  or  to  the  inordinate  cost  of  measurements; 
unpredictable  environmental  effects;  manufacturing  tolerances;  changes 
in  the  characteristics  due  to  ageing,  wearing,  loading,...;  etc.,  and  2)  the 
use  of  inherently  unstable  plants,  e.g.  rockets,  some  chemical  reactors ,  some 
nuclear  reactors,  some  advanced  design  airplanes,...,  etc.  The  effective¬ 
ness  of  feedback  in  coping  with  uncertainties  was  actually  illustrated  in 
the  process  of  Black's  invention  of  the  negative  feedback  amplifier  [A]: 
he  realized  that  an  "open-loop"  cancellation  scheme  is  impractical 
(because  it  requires  the  two  "paths"  track  each  other)  and  he  eventually 
conceived  the  negative  feedback  amplifier.  Moreover,  Black's  paper  [3] 
exhibited  many  of  the  achievable  advantages  of  feedback  such  as  desensi¬ 
tization  and  disturbance  attenuation. 

Even  though  most  of  the  existing  expositions  of  the  effects  of 
feedback  are  essentially  based  on  transfer  functions  calculations  (thus 
necessarily  restricted  to  the  linear  time-invariant  case  only) ,  we  believe 
that  benefits  of  feedback  are  the  consequence  of  two  facts :  first, 

£  topological  structure  -  the  loop;  second,  an  order  of  magnitude 
relation  (in  the  context  of  Black's  classical  paper  [3],  it  reads  |Sp|  >>  1) 
which  is  independent  of  the  linearity  requirement.  Pursuing  this  point 
of  view,  we  derive  below  the  basic  properties  of  feedback  in  a  much  more 
general  framework:  we  make  full  use  of  the  recent  developments  in  the 
input-output  formulation  of  nonlinear,  distributed,  time-varying,  multi¬ 
input,  multi-output  systems  (see  e.g.  15,6,7,8]).  Such  formulation 
allows  for,  unstable,  continuous- time  as  well  as  discrete-rtime  subsystems; 
this  is  achieved  by  using  causality  and  the  technique  of  extended  spaces, 
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i.e.  considering  only  the  time  interval  [0,T],  with  T  finite  but  arbitrary. 
The  contents  of  this  paper  are  as  follows . 

I.  Introduction 

1.1  Notation.  1.2  General  framework 

II.  Black’s  formula  generalized 

III.  Advantages  and  limitations  of  feedback 

III.. I  Densensitization.  III. 2  Disturbance  attenuation. 

III. 3  Linearizing  effect.  III. 4  Asymptotic  tracking  and  distur¬ 
bance  rejection.  III.  5  I'tabilization 

IV.  Conclusion 
References 
Appendix 

1.1  NOTATION 

Let  H  ((C)  denote  the  field  of  real  (complex,  resp.)  numbers.  Let 
IN  denote  the  set  of  non-negative  integers.  Let  <§  denote  the  set  of 

T 

non-negative  rational  numbers.  Let  R+  denote  the  non-negative  real 
0 

line  [0,®°) .  Let  C+  denote  -the  open  right-half  complex  plane. 

Let  H[s]  (R(s))  be  the  set  of  all  polynomials  (rational  functions,  resp.) 
in  s  with  real  coefficients.  Let  HpXq‘  (CpXq,  R[s]pXq,  R(s)pXq)  denote 
the;  set  of  all  pxq  matrices  with  elements  in  R  (<D,  R[s],R(s),  resp.). 

Let  0p(s)  denote  the  degree  of  p(s)  6  R[.s] .  Let  3"  C  be  the  set  of 
time  instants  at  which  various  signals  of  interest  are  defined:  typically, 

^  =  IR_j.  for  the  continuous-time  case,  *  CN  for  the  discrete  time  case.  Let 
^  be  a  normed  (seminormed)  space  of  functions  mapping  into  some 
vector  space  'f ,  (typically,  'If  =  Rn,  -ft  =  l“,  L^  or  etc.). 

Associated  with  the  .normed  (seminormed)  space  171  is  the  extended  normed 


(seminormed)  space  defined  by  'fY!  :=  +tlf\  VTS4!T,  |f|^,<co}, 

where  |f|  :=  |f  |,  f^  is  obtained  from  f  by  a  projection  map  P^,  more 

rf(t),  t  <  T 

precisely,  f  :=  P  f  is  defined  by  f  (t)  =<  ,  for  t,  T  S  ¥  Let 

'•O  ,  t  >  T 

Fy^e  denote  the  class  {P^,f|fG^}.  Let  H •'iVe  H  is  said  to  be 

causal  iff  P  HP  =  P  ll,  VT  £  CT  [8,  p. 38-39].  "Nonlinear"  means  "not 
necessarily  linear".  means  "Js  defined  by",  "u.f.c."  means  "under 

these  conditions".  Operators,  i.e.  maps  from  7M  into-^,  are  labelled 
by  boldface  symbols  (e.g.  G,K,F,...).  Let  | * | ^  denote  the  J^-norm  on  G0* 

Let  C1  denote  the  class  of  continuously  differentiable  maps  [19,  pp.  172]. 

We  write  a  <<  b  to  mean  that  a  is  very  small  compared  to  b. 

1.2  GENERAL  FRAMEWORK 

We  will  consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1, 
where^ 


G:  H  -*■  V.  ,  is  a  nonlinear,  causal  operator  representing 
~  e  <fe 

the  plant, 

K:  is  a  nonlinear,  causal  operator  representing 

the  compensator , 

F:  Ye  *  Ke>  is  a  nonlinear,  causal  operator  representing 
the  feedback, 

r  is  the  system  input, 

u  <=  U.q,  is  the  plant  input, 

y,  £  is  the  system  output, 

e  £  d  ,  is  the  error  signal, 
e - - 

<jj^,  ^  are  extended  normed  spaces,  unless  otherwise 

stated  (hence  P,„R  ,etc.  are  normed  spaces  with  norm 
~l  e 

denoted  by  | • |) . 


(I.D 

(1.2) 

(1.3) 

(1.4) 

(1.5) 

(1.6) 

(1.7) 

(1.8) 
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We  shall  assume  that 


(I+FGK)  ^  is  a  well-defined  nonlinear,  causal  operator  (1.9) 

mapping  from  ^  into  ft  . 

For  specific  conditions  under  which  assumption  (1.9)  holds,  see  for  example 

[7,  sec.  2.8;  8,  pp.  47],  Note  that  the  closed-loop  input-output  map 

H  :  r  +  y  is  given  by  GK( I+FGK)  \ 

~yr  >  - 


II.  BLACK'S  FORMULA  GENERALIZED 

H.S.  Black's  invention  of  the  negative  feedback  amplifier  was 

based  on  the  following  analysis  [3]:.  consider  the  feedback  system  S 

shown  in  Fig.  I . 1 ;  let  GK  and  F  be  specialized  into  the  scalar  transfer 

functions  p  and  3,  respectively,  then  the  closed-loop  input-output 

(2) 

transfer  function. is 


h  JB  _Ji_  =  I.JlL. 

yr  l+3p  3  l+3p 

=  ir  i - L_i 

3l  1+Bp 

1 

■  3 

for  those  frequencies  where  [BpI  »  1. 


(11. 1) 

(11. 2) 

(11. 3) 


Black's  crucial  observation  is  that  for  those  frequencies  where 
J3p]  »  1,  or  equivalently  |l+3p|  »  1,  the  output  y  *  i  r,  iie'»  the 
closed-loop  input-output  transfer  function  is  essentially  independent 
of  p  and  is  essentially  specified  by  3-  So  the  recipe  is:  3  is  speci¬ 
fied  by  the  desired  h ^  and  the  forward  path  gain  p  is  made  as  large  as 
possible  to  achieve  (II. 3). 

Equations  (II.1)-(II.3)  summarize  Black's  fundamental  observation. 

We  note  that  it  is  valid  because  l)  there  is  a  loop  structure,  and  2)  the 


•S?  •VWSKWW  «»i 


| 


f 


i 

! 

j 

{ 

I 


I 


f/ 

f',- 

-S’* 


i  *' 


V 


\ 


? 

1 


* 

$ 

\ 


i 

V 


loop  gain  |B|i|  is  large.  This  reasoning  can  be  greatly  generalized  to 
the  case  of  nonlinear  system  S  shown  in  Fig.  1.1.  Note  that  in  the 
linear,  time-invariant  case,  we  only  have  to  consider  the  sinusoidal  in¬ 
puts  within  some  frequency  band  of  interest  and  the  corresponding  sinu¬ 
soidal  steady-state  response.  But  in  the  nonlinear  case,  we  have  to 
formulate  the  condition  i.t  terms  of  inputs  of  interest,  e.g.,  sinusoids 
of  various  frequencies  and  amplitudes,  step,  ramp,  parabolas,  etc. 

Theorem  II. 1:  (Black's  formula  generalized:  soft  version) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig  1.1  and 
described  by  Equations  (I.l)-(1.9).  Let  g  C  be  the  set  of  inputs 
of  interest.  U.t.c.  if,  for  T  sufficiently  large, 


Hence  for  all  r  &  lR 

e 

r  -  F  H  r  =  (I+FGK)_1r 
'  ~yr  ~  — 

Now  let  r  S  <R,  C  /f?  and  let  T  6  J  be  large,  then,  using  (II. 4), 
d,e  e 

I?  -  ?  IJyrr I x  =  Kl+FGKj^r^  «  | r | T 
and  (II. 5)  follows.  Q.E.D. 


Remarks  II. 1:  a)  (II. 5)  says  that  the  feedback  system  II  ^  followed  hy 
F  behaves  approximately  like  an  identity  operator  as  far  as  the  inputs 
of  interest  are  concerned.  Equivalently,  F  is  an  approximate  left- inverse 
of  H^r  °n  ^ d  e»  thus,  on  $d  e>  H  is  essentially  Independent  of  G  and 
is  essentially  specified  by  F.  (The  left  inverse  is  the  one  of  interest 
because  any  operator  P:  *U  -»  ^has  a  right  inverse  Q  in  the  sense  that 
there  always  exist3  a  Q  such  that  PQ  =  1^  where  1^  denotes  the  identity 
restricted  to  PflbO). 

b)  Consider  G  perturbed  into  G;  call  H  the  resulting  closed-loop 

input-output  map.  If  G  satisfies  (II. 4),  then  F  H^r  -  I,  on  g;  i.e., 
on  (R ,  ,  ’I ,  is  insensitive  to  the  plant  perturbations.  This,  however, 

does  not  assei  that  the  relative  change  in  H  will  be  much  less  than 
that  in  G;  it  simply  asserts  that  changes  in  G  have  litl  ,  effect  on  H 
The  exact  relation  between  the  relative  change  in  H  and  the  relative 
change  in  G* is-  given  by  Equation  (111^7)  below  and  discussed  in  Remarks 
III.l.  ;  , 

c)  (11.5)  is  a  soft  version  of  Black's  -formula  (II. 2)  To  obtain 

Hyr  -  F  ^  requires  sojae  additional  assumptions.  This  is  done  in 
Theorems  II .2  and  lif.3  "below.  H 


yr 


Note  that  eqn.  (II. 1)  gives  the  exact  relation 


1  _  1  1 
yr"$  "3  im 


(II. 7) 


As  feedback  designers  know  (see  e.g.  [9]),  it  is  often  advantageous  to 
write  this  equation  in  terms  of  the  "inverse  loop-gain" 


1 

6 


1JM_L 
3  l+(3u)-1 


(II. 8) 


Theorem  II. 2  below  generalizes  Black's  result  to  the  nonlinear  case: 

-1 

an  estimate  of  the  difference  H  r-F  r  is  obtained  under  the  condition 

~yr 

that  the  "inverse  loop-gain"  is  small  for  the  class  of  inputs  of 
interest.  Note  the  similarity  in  form  between  the  right-hand  sides  of 
eqn.  (II. 7)  and  eqn.  (It. 9)  below. 


Theorem  II. 2  (Generalized  Black  formula) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 
described  by  eqns.  (I . 1)— (1.9) .  Let  ^  g  C  be  the  set  of  inputs  of 
interest.  Suppose  that 


(al)  VT  E^T,  P^c  is  a  Banach  space; 

(a2)  F  ^  and  (FGK)  ^  ■*  ft  are  well-defined  nonlinear, 

**  6  (/  C  •***>***»  6  6 

causal  maps; 

••1  (3) 

(a3)  (FGK)  is  continuous'  '  on  ^e,  and  for  each  r  €  ^  , 

zn+l  r”  lzn  G  ^^d  ^  C  ^e*  where  z0  “  r,  n  ^55, 

and/V(^^  g)  denotes  a  neighborhood  of  e  in 


U.t.c.  if 


(i) 


|F“1(r-e)-F~Lr|T 
sup  — - rn— ~ - <  00  ; 

rGtf  ,  TST  ”*T 

d»e  -i 

e  :=  (I+FGK)  r 

e^O" 


X(F  L)  ;  = 


(ii) 


for  each  T  G  T, 


.  |(FGK)"1r1-(FGK)'Ar9L 

Yt[  (FGK)  ]  :=  sup  - r- — — r -  <  1 


^-1 


V'2S*V  1  2'T 


rl,T  *  r2,T 


Chen,  for  each  T  G  tT, 

|H  rr-f  lr|T  1  Xff-1) 


| (FGK)"  r| 

lx - — - f-  }  Vr  G  £ 

l-^tCFGK)"1]  d,e 


In  particular,  if  for  T  G  S'  sufficiently  large, 


YtI (fgk)-1]  «  1 


and 


|F_1r  |,„ 

|(FGK)“xr|  «  T1  ,  Vr  G  £ 

+*+***  i  X(K  "**)  ^ ) c 


,“1 


then  asymptotically, 


H  =  F_1  on  £, 
~yr  -  d,e 


in  the  sense  that  for  T  G^T"  sufficiently  large, 


|H  r-F-1r  l„  «  I  F-1r  |’  ,  Vr  G  £ 

‘~yr  ~  ‘T  ‘T  d,e 

Proof  of  Theorem  II. 2:  see  Appendix. 

Remark  11,2:  Note  that  the  classical  Black  condition  that  |By| 
(which  is  achieved,  in  design,  with  (p|  »  1)  is  a  sufficient  c 
for  the  approximation  (II. 2).  Thus  one  may  want  to  pursue  the 


(It. 9) 

(11. 10) 

(11. 11) 

(11.12) 

(11.13) 

»  1 

ct.diiipn 
idea  of 


small  inverse  forward  path  gain  (large  |y|  in  the  single-input  single¬ 
output  case)  as  follows:  assuming  the  existence  of  the  required  inverses, 
from 


H  =  GK(I+FGK) 
~yr  —  ~  — 


-1 


(11.14) 


we  obtain 


H_1  =  (I+FGK)(GK)_1 
-yr  —  *******  **** 

=  F+  (GK)_1 


(11.15) 


This  formula  is  the  generalization  to  the  nonlinear  case  of  the  well- 
known  corresponding  relation  with  matrix  transfer  functions  [9,  p.  121] 
If  we  assume  that  Vy  £  ^  q,  the  set  of  outputs  of  interest,  and  for 
T  sufficiently  large 


(GK)"3'y|T  «  |Fy|T 


(11.16) 


then,  asymptotically 


H-3"  a  F  ,  on  U 
~yr  ~  «d,e 


(11.17) 


in  the  sense  that  for  T  sufficiently  large,  |H^y-Fy|,j,  <<:  I^T’ 

Vy  ^  %>  •  Note,  however,  since  F  and  H  are  nonlinear,  eqh.  (11.17) 

»d,e  ~  ~yr 

-1  a 

does  not  imply  that  11 


~yr 


Going  back  to  the  Black  formula  (II. 1),  we  note  that  the  approxima¬ 


tion  (II. 2),  h^r  4  •£,  is  valid  as  long  as 


ir  <<  ft 


(11.18) 


Theorem  II .3  below  generalizes  this  condition  to  the  nonlinear  case: 

eqn.  (11.18)  should  be  compared  with  the  condition  (ii)  of  Theorem  II. 3  belt 
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Theorem  II. 3: 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 
described  by  eqns.  (I.l)-(1.9).  Let  ^  g  C  ^  he  the  set  of  inputs  of 
interest.  Suppose  that  F  ^  is  a  well-defined  nonlinear,  causal 

me  p. 


U.t.c.  if 


(i) 


X(F  x)  := 


JF  i(r-e)-F  lr|. 


sup 

rM,  .  T G^ 
d,e 

e  :=  ( H-FGK)  r 

eT  $  0~ 


< 


(ii)  for  T  GtT  sufficiently  large, 


X(F"1)-|(I+FGK)"ir|  «  |H“Ar|  ,  Vr  Gtf,  , 
~  —  ~~~  j.  -  i  a ,  e 


-1 


-1 


then,  asymptotically, 


in  the  sense  that  for  T  sufficiently  large, 


IVZ’H 


« 


Vr  G 


(11.19) 


(11.20) 


Proof  of  Theorem  II.  3:  see  Append.-.x. 

Corollary  11.3.1  (F  linear) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 

by  eqns.  (I.1)-(I«9).  Let  F  be  linear.  Let  F  ^  •>  ^  be  a  well-defined 

linear  causal  map.  Let  e  >je  c^e  set  ■’•nPu*:s  °f  interest. 

U.t.c.  if  for  T  sufficiently  large  and  V  y  G  F  ^ A, 

a ,  e 

|(l+GKF)-1  y|,T  «  |y|T 


then  conclusions  (11.19)  and  (11.20)  hold. 


Proof  of  Corollary  I.1 .3.1:  see  Appendix. 


Corollary  II.  3.2  (Linear  t  Line-  Invar  la.-  *•  case) 

Consider  the  feedback  system  S  shown  in  Pig.  1.1  and  described  by 
eqns .  (I.l)-(1.9).  Let  the  operators  G,  K,  and  F  be  linear,  time-invariant 
and  represented  by  transfer  function  matrices  G(s),  K(s)  and  F(s), 
respectively.  Let  ^  ^  C  ^  consist  of  all  sinusoidal  inputs  with 
frequencies  in  some  interval  12  C  ii.  Suppose  that 

(al)  F  ^  •*  %  is  a  well-defined  causal  map; 

~  e  fe 

(a2)  the  closed-loop  system  is  exp.  stable,  i.e.  the  impulse  response 


of  the  transfer  function  H  : 


exponential. 


~yr 


r  y  is  bounded  by  a  decaying 


U.t.c.,  if  Vw  €  !2,  Vy  G  range[F(Jw)  C  s  ® 
|  [  (I+GKF)  (jw)  ]~ly  |  «|y|  , 


(11.21) 


then 

Hyr(jw)  -  F(Jw)“i,  Vw  S  Q  (11.22) 

in  the  sense  that  Vr  6  cn 


|Hyr(jw)r-F(jw)  1r|  «  |F(jw)“1r | ,  Vw  G  fi  (11.23) 

Proof  of  Corollary  11.3.2;  see  Appendix 

Remark  11.3.2:  If  we  use  the  J^-norm  in  (EU ,  condition  (11.21)  is  satis¬ 
fied  if  the  largest  singular  value^  of  [  (I+GKF)  (jw)  l"1  is  much  smaller 
than  1,  for  all  w  G  Q. 
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Comments  on  Theorems  II. 2  and  II. 3: 

(a)  Theorems  II. 2  and  II. 3  conclude  that,  under  suitable  conditions,  the 

output  y  =  H  r  is,  asymptotically  (i.e.  for  large  T) ,  approximately  equal 
-1 

to  F  “r  over  the  inputs  of  interest  within  a  small  relative  error.  Thus 
eqns.  (11.12)  and  (II.  1 9)  are  complete  generalizations  of  the  Black  formula 
(II. 2)  to  the  nonlinear,  time-varying,  multi-input,  multi-output,  distrib¬ 
uted  systems  S  shown  in  Fig.  1.1  and  described  by  eqns.  (I . 1) — (I .9) . 

(b)  Typically,  ^  g,  the  set  of  inputs  of  interest,  consists  of  sinusoids 
of  various  frequencies  and  amplitudes,  or  steps,  ramps,  parabolas,  etc., 
of  various  magnitudes. 

(c)  Note  that  the  extended  spaces  framework  allows  us  to  treat  the  case 


where  some  of  the  operators  G,  K,  F  may  be  unstable  and  to  state  asymptotic 

*s»  •< 

conditions  such  as  eqns.  (11.10),  (II. 11). 

(d)  It  is  the  nonlinearities  of  the  maps  G,  K,  F  which  forces  us  to  use 
the  incremental  gain  (e.g.  Y,j,l(FGK)  in  theorem  II.  2),  or  Lipschitz 
constants  (e.g.  A(F  *)  in  theorems  II. 2  and  II. 3),  over  appropriate  sets, 
to  obtain  our  estimates.  In  the  linear  case,  one  would  use  the  induced 
norms  of  the  corresponding  maps  over  appropriate  sets. 

(e)  Theorems  II. 2  and  II. 3  have  important  design  implications:  Given  a 
plant  G,  we  first  choose  F  such  that,  over  the.  inputs  of  interest,  F-"*"  is 
asympotically  the  desired  input-output  map.  Next  we  choose  the  compensa¬ 
tor  K  so  -that  the  conditions  of  theorem  IT. 2  (or  of  theorem  II. 3)  are 
satisfied.  Then,  asymptotically,  the  closed- loop  input-output  map  H  is 
close  to  F  1  over  the  inputs  of  interest  as  we  desired. 

(f)  Note  that  F  ^  can  be  nonlinear.  A  simple  well-known  example  of 
realizing  a  nonlinear  map  by  a  feedback  system  (with  large  forward-path 
gain)  is  the  logarithmic  amplifier  shown  in  Fig.  II. 1  Recall  that  node  fl} 


is  a  virtual  ground,  and  that,  the  diode  operates  at  currents  much  larger 
than  its  saturating  current  1^,  thus  F  i^  h— *-  Vq  is  given  by 
v0  =  “V  «  -v  In  dD/ls).  Hence  vQ  -  -v;f  In  [v^,/ (R^) ] . 


Examples: 

To  illustrate  the  implication  of  the  generalized  Black  formula  on 
nonlinear  dynamical  systems,  we  present  the  following  two  examples: 


Example  II. 1  (Nonlinear,  single-input  single-output  dynamical  system) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1,  where 

g 

G  is  characterized  by  a  rational  transfer  function - ~ - r~ 

(s+l)(s+l(T)(s+10  ) 

followed  by  a  nonlinear  memory  less  map  <j>(*)  with  4>(*)  ^  C^-  described  by 


<|>(z) 


VMrv  ^ 


11  __ 

30  +  ^30-’  ■‘18. 75  ’ 
0.8z 


0.8eZ+0,5-1.2 


z  >_  0.5 
|z|  <  0.5 
z  <  -0.5 


(11.24) 


K  and  F  are  characterized  by  constants  k  and  1,  respectively.  The  closed- 
loop  system  and  the  characteristics  of  the  nonlinearity  (f>(*)  are  shown  in 
Fig.  II. 2  and  Fig.  II. 3,  respectively.  By  theorem  II. 2  (or  theorem  II. 3), 
if  k  becomes  large,  then,  asymptotically,  the  output  y  of  the  closed-loop 
system  will  be  approximately  equal  to  the  reference  signal  r(*)  (since 
F-^  =  1  in  this  case).  Fig.  TT .4  -  Fig .  IT. 6  show  the  system  output  y(*), 
the  error  signal  e(*),and  z(*)»  the  input  to  the  nonlinearity  <f> ( • ) ,  in  the 
"steady  state"  for  different  values  of  k  while  the  closed-loop  system  is 
driven  by  r(t)  =  sin  lOt.  The  effect  due  to  high  forward-path  gain  in  a 
feedback  system  is  clearly  illustrated  by  Fig.  11.4.  Note  that  the  high 
forward-path  gain  distorts  z(0,  the  input  to  the  nonlinearity  <{>(•),  so 


-15' 


that  asymptotically,  the  output  y(*)  is  approximately  equal  to  sin  lOt. 


Example  II . 2  (Nonlinear,  multi-input,  multi-output,  dynamical  system) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1,  where 
G  is  characterized  by  a  rational  function  matrix 


L(s)  - 


5x  10 


8 


lx  10 


8 


(s+1) (s+103) (s+104)  (s+1) (s+103) (s+104) 


5  x  10 


5  x  10 


8 


[_  (s+1) (s+103) (s+104)  (s+1) (s+103) (s+104) J 


(11.25) 


followed  by  a  nonlinear  memoryless  C  map  <S>(*)  described  by 
(1  +0.2  tanh  z^)  *v(z^) 


H 


)  = 


(1+0.2  tanh  z^)  ‘V^) 


(11.26) 


with 


v(z)  := 


r3  .  ,J|z|~3/7 
sgn  z*[y  +  Y  14 — 


,  if  jz|  <0.5 
J  ,  if  |z|  >0.5  , 


(11.27) 


K  and  F  are  represented  by  the  constant  matrices  kl  and  1,  resp.,  both 

.  TO  2x2 
in  1R 

The  closed-loop  system,  the  characteristics  of  v(z) ,  and  the  characteristics 
of  1 +0.2.  tanh  z  are  shown  in  Fig.  11.7,  Fig.  II. 8,  and  Fig.  II. 9,  respec¬ 
tively...  By  theorem  II. 2  (or  theorem  II. 3),  if  k  is  sufficiently  large, 
then,  asymptotically.,  the  output  y  of  the  closed-loop  system  will  be 
approximately  equal  to  the  reference  signal  r  (since  F  ^  =  I  in  this  case). 
Fig;  II. 10 -Fig..  11.13  show  the  system  output  components  y^ ( *■ ) »  and 

the  error  signal  components  e  (•) ,  ,  respectively,  for  different 

values  of  k  GS  while  the  closed-loop  system  is  driven  by  the  reference 

j.  Pig.  II. 10  and  Fig.  II. HL  show  that  as 


~rr 

sin  lOt 

-r2- 

0.8  sin  15t 

we  Increase  the  compensator  gain  k,  the  system  output  (vector)  function 
approaches  to  the  reference  signal  r  as  if  the  closed-loop  system  was  an 
identity  map  despite  the  complicated  couplings  in  the  nonlinear  plant  G. 

Fig.  11.14  and  11.15  show, for  k  =  40,  a  period  of  the  steady-state  trajec¬ 
tories  of  the  system  outputs,  y(‘),  and  of  the  nonlinearity  inputs,  z(*)> 
on  the  y-plane  and  z-plane, .respectively.  Note  that  the  greatly  distorted 
trajectory  of  z(*)  (due  to  the  qoupling  and  saturation  effects  of  $(*)) 
produces  a  system  output  y(*)  very  close  to  the  reference  signal  J^q  ^sin^LSt J 
Consider  the  three  large  irregular  lobes  on  the  z(*)  trajectory  in  the 
2nd,  3rd  and  4th  quadrant  of  Fig.  11.15  which  reach  their  peaks  at  time 
instants  t  =  4.54,  4.90,  5.55  respectively.  Observe  that  at  those  time 
instants,  at  least  one  of  the  desired  plant  output  component  (y*  «  sin  10t, 
y2  =  0.8sinl5t)  reaches  the  peak  of  the  negative  cycle  of  sinusoidal 
waves  (see  Fig.  II. 10  and  Fig.  II. 11).  Further  observe  that  y^  and  z  , 
y2  and  are  of  same  sign  for  all  t  since  l+0.2tanhz  >  0  and  v(z)  is 

an  odd  function.  Now  at  time  t  =  4.54,  the  desired  plant  output  y*(t)  -  .98, 
y2^  ”  t*lus  v(z^)  (v(z2))  is  required  to  operate  in  its  positive 

(negative,  resp.)  "saturation"  region.  Due  to  the  negative  value  cf  z2> 

1 +  0.2  tanh  z2  =  0.8.  Consequently,  (1 +0.2  tanh  z2)v(z^)  "saturates" 
earlier  than  V(z^)  Itself  and  z^  is  required  to  be  a  large  positive  number 
so  that  y^  =  (1 +0.2  tanh  z2)v(z^)  will  be  approximately  equal  to  the 
desired  value  0;98.  This  explains  the  large  lobe  on  the  trajectory  of 
z(*.)  in  the  4th  quadrant.  Similar  reasoning  explains  the  other  two  large 
lobes  in  the  2nd  and  3rd  quadrant. 


III.  ADVANTAGES  AND  LIMITATIONS  OF  FEEDBACK 


Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 
described  by  eqns.  (I.l)-(1.9)  which  satisfies  the  conditions  stated  in 
theorem  II. 2  (or  theorem  II. 3),  then  asymptotically,  the  closed-loop 
system  input-output  map  H  is  approximately  F  Thus  we  should  expect 
that  the  closed-rloop  system  input-output  map  is  insensitive  to  the  varia¬ 
tions  in  the  forward  path  map  GK  and  that,  if  F  is  linear,  the  closed-loop 
system  is  close  to  a  linear  system  even  though  the  forward  path  map  GK 
is  highly  nonlinear. 

In  the  following,  we  show  the  advantages  and  limitations  of  feedback 
for  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1:  section  III.l 
calculates  the  exact  effect  of  plant  perturbations  on  the  closed-loop  input- 
output  map  and  demonstrates  the  relations  between  desensitization  and  i) 
the  feedback  structure,  ii)  the  perturbation  on  the  feedback  map  F,  and 
iii)  the  closed-loop  stability;  section  III. 2  establishes  the  exact  effect 
of  various  additive  external  disturbances  on  the  closed-rloop  system  output; 
section  III, 3  defines  a  nonlinearity  measure  and  then  shows  precisely 
that  feedback  has  a  linearizing  effect  on  a  nonlinear  plant;  sections 
III. 4  and  III. 5  briefly  review  the  idea  that  feedback  can  achieve  asymp¬ 
totic  tracking  and  disturbance  rejection,  and  stabilize  unstable  systems. 

111,1  DESENS ITIZATION 

One  of  the  major  reasons  for  using  feedback  in  design  is  that  feed¬ 
back  can  reduce  the  effect  of  the  plant  perturbations  on  the  input-output 
map.  One  way  to  quantitatively  demonstrate  the  desensitization  effect  of 
feedback  is  to  compare  a  feedback  design  with  a  corresponding  openr-loop 


design  [10]:  consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1 
and  described  by  eqns.  (IJ.)-(I.9) .  Note  that  the  closed-loop  input-output 
map  H  :  r  *■  v  is  given  by  GK(I+FGK)  Also  consider  a  comparison  open- 

-N*yir  ~~  ~  ~ ~~ 

loop  system  (shown  in  Fig.  III.l)  consisting  of  the  same  plant  G  preceeded 
by  a  compensator  K^.  Thus  the  open-loop  input-output  map  r:  r  *— ►  y^ 


is  given  by  GKq.  Now  if  we  select 
Kq  =  K(I+FGK)_1  , 


(III.l) 


then  for  all  system  inputs  r,  y  =  y^,  i.e.  the  (nominal)  open-loop  input- 

output  map  H  :  r  y  is  identical  to  the  (nominal)  closed-loop  input- 
~y0  U 

output  map  H  :  r  *■  y.  Consider  now  an  arbitrary,  not  necessarily  small , 

perturbation  AG  on  the  plant  G,  then  the  plant  G  becomes  G  :=  G  +  AG;  the 

closed-loop  (open-loop)  system  input-output  map  H  (H  )  becomes 

~yr  ~yQr 

V  ;=  ?yr+A5yr  =  “‘PfS®'1,  <6^  ’  §5o  " 

resp.).  The  perturbed  closed-loop  (open-loop)  system  is  shown  in  Fig.  III. 2 

(Fig.  III. 3,  respectively). 

Note  that  the  changes  of  the  closed-loop,  and  the  open-loop  system 
input-output  maps  due  to  the  plant  perturbation  AG  are  given  by 


AH  :  =  H  -  H  =  GKd+FGK)-1  -GK(I+FGK)_1 
-yr  — yr  ~y  r  ~ 


ALr  !=  »yAr-“yAr  =  ®5o  "  S5o  =  A^0  = 


(111. 2) 

(111. 3) 


"V  q-  ^0  'v/ Q*“  ^  ~  ~ 

respectively. 

Theorem  III.l  below  generalizes  some  of  the  results  in  [10,11,12,46] 

and  establishes  the  exact  relation  between  AH  and  AH  ,  and  thus  makes 

-  ~yr  ~yQr 

precise  the  desensitization  effect  of  feedback  for  nonlinear  systems. 


Theorem  III.l  (Desensitization  of  plant:  perturbation  by  feedback) 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and 

described  by  eqns .  (I.l)-(1.9).  Also  consider  the  comparison  open-loop 

system  shown  in  Fig.  III.l.  Let  AH  and  AH  denote  the  changes  of  the 

~yr  ~yQr 

closed-loop,  and  the  open-loop  system  input-output  maps  due  to  the  plant 
perturbation  AG,  respectively.  Assume  that 


(al)  F:  •+  ^  is  linear; 

~  **«  —  1 

(a2)  the  perturbed  plant  G  satisfies  (1.9),  i.e.  (I+FGK)  is  a  well- 

defined  nonlinear,  causal  map  mapping  into 

(a3)  GK:  ^  ^  and  (I+GKF)"1:  ^  ^  are  C1  maps, 

then 

AH  =  f  tI+D(GK)-F]-1da»AH  ,  on  ^  (III. 4) 

~yr  J0  ~  ~~  ~  -y0r  e 


where  the  Frechet  derivative  [13,  p.  32]  D(GK)  is  evaluated  at 

(I+FGK)  ^(r+OiAr)  with  Ar  :=  F*AH  (r) ,  and  a  G  [0,1]. 

~  — -  -yQr  e 

Proof  of  Theorem  III.l:  see  Appendix. 

When  the  map  GK  is  linear,  theorem  III.l  reduces  to  the  following 
well-known  result  [10;  11,  p.  24-26;  11  includes  an  extensive  bibliography]. 


Corollary, III.  1.1  (Linear  case).; 

Under  the  conditions  stated  in  theorem  111.1,  if  in  addition,  GK  is 
linear,  then 


=  (I+GKF) 

•W  'K'W'V 


-1 


(III. 5) 


Proof  of  Corollary  III. 1.1:  Follows  directly  from  the  fact  that  D(GK)  =  GK, 
when  GK  is  linear. 


Remarks  II1.1: 

(a)  Theorem  III.l  indicates  that  for  a  class  of  plant  perturbations  AG, 
if  K  and  F  are  chosen  such  that  ^  ^  e  (c  ,  the  class  of  inputs  of 
interest. 


1 1  [I+D(GK) *F]-1da*AH  (r) |  «  |AH  r(r) |  (III. 6) 

J0  "  ~~  "  ~yor  ~yor- 


then,  for  such  inputs  r(*),  the  change  of  output  (AH  (r))  in  the  feedback 
system  S  caused  by  the  plant  perturbation  AG  is  much  smaller  than  the 
corresponding  change  in  the  open-loop  system.  Thus,  with  appropriate 
feedback  design,  the  nonlinear  closed-loop  system  can  be  made  less  vulnerable 
to  the  perturbations  on  the  plant  and  hence  performs  more  closely  to  the 
desired  input-output  map. 

(b)  Equation  (III. A)  makes  precise  the  concept  (built  upon  linear  cases) 
that  if  one  makes  the  (linearized)  Inverse  return  difference  small,  then 
the  closed- loop  system  is  insensitive  to  the  plant  perturbations.  Note 
that  eqh.  (Ill, A)  states  precisely  where  D(GK)  has  to  be  evaluated  arid 
along  what  path  the  linearized  inverse  return  difference  map  should  be 
integrated. 

(c)  Differential  sensitivity:  suppose  that  G,  H  are  invertible,  then 

-y  it 

eqn.  (III. A)  implies  that,  since  AH  =  AG*G  ^*GK(I+FGK)  \ 

r  «Si»  M  N  'WM'V 

-1  f1  ~  -1  -1 

AH  -H  =  \  [I+D(GK) • F]  da*AG*G  (III. 7) 

~yr  ~yr  Jn  ~  ~~  ~  ~  ~ 


For  AG,  hence  Ar,  sufficiently  small,  (III. 7)  can  be  approximated  by 
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(III. 8) 


AH  •H-1  -  [1+D(GK)*F]“1»AG*G' 

~yr  -yr  ~  ~  ~  ~ 

The  mop  [I+D(GK)*F]  ^  is  thus  a  complete  generalization  of  the  classical 
differential  sensitivity,  function  (for  linear  time-invariant  case,  see, 
e.g.  [14,15]  for  single-input  single-output  case,  [10]  for  multi-input 
multi-output  case;  for  some  nonlinear  case,  see  e.g.  [11]). 

(d)  Consider  the  special  case  where  G,  K,  F  are  represented  by  some  trans¬ 
fer  function  matrices  G(s) ,  K(s) ,  F(s),  respectively.  To  achieve  desensi¬ 
tization  with  respect  to  the  given  plant  G(s)  by  feedback,  one  may  design 
K(s)  and  F(s)  so  that  the  maximum  singular  value  of  the  matrix 

•v 

[I+G(ju)K(jo))F(jw)  ]  be  much  less  than  1  over  the  frequency  band  of 

interest)  Then,  by  Corollary  III.l,  |  (AH  r)  ( jos)  L  «  |  (AH  r) ( jw) |  , 

n  ~yr  ‘  2  ~y0  2 

for  any  (AH  r) ( jw)  G  <E  over  the  frequency  band  of  interest.  Note  that 

~y0 

this  requirement  is  not  equivalent  to  the  following;  "over  the  frequency 
band  of  interest,  | X±( jto)  |  »  1,  Vi,  where  A^jw)  is  the  i-th  eigenvalue 
of  I +  G(jw)K(jw)F(jw)"  .  Hence,  in  the  linear,  time-invariant,  multi-input , 
multi-output  case,  plotting  the  eigenvalue  loci  of  X  +  G(jw)K(jw)F(jw) 
with  W  as  a  parameter,  although  useful  for  stability  studies  [16,17], 
does  not  have  the  same  desensitization  Interpretation  as  in  the  single- 
input,  single*routput  case  (see  e.g.  [14;  15,  Chap.  11]). 

Discussion: 

A.  Desensitization  and  Feedback  Structure:  We  note  that  one  feedback 
structure  is  not  necessarily  superior  to  another  one  in  terms  of  sensitivity 
with  'respect  to  the  planp.  We  compare  the  nonlinear,  feedback  system  S 
shown  in  Fig.  I.l.and  described  by  eqns.  (1.1)— (1.9)  with  the  nonlinear, 
multi-loop,  feedback  system  shown  in  Fig.  HI. 4  which  consists  of  the 


««w. 


same  plant  G  and  nonlinear,  causal  operators  K.  ,  K„,  F  and  F  . 

—  -1  ~Z  *«1 

Suppose  that  the  (nominal)  closed-loop  system  input-output  maps  of 
these  two  nonlinear,  feedback,  systems  are  identical,  i.e. 

GK(I+FGK)_1  =  GK2(I+F2GK2)"1K1[I+FlGK<,(I+F2GK2)‘1K1]"1  (III. 9) 

Now  we  have  the  following  result. 


Proposition  III. 2: 

If  GK,  GK„,  K,  arc  linear,  then  eqn.  (III. 9)  becomes 

~~  Z  — — — 


<I+GK.F)_1GK  =  [  I+GK  (F,  +K.F. )  ]""i,CK0K1 

•v  **  Z  '■'I'v.L  ~  ~  Z 


(III. 10) 


Proof  of  Proposition  III. 2:  see  Appendix. 


With  eqn.  (III. 10),  the  relation  of  the  (differential)  sensitivities 
of  the  two  feedback  structures  shown  in  Fig.  1.1  and  Fig..  III. A  is  made 
clear  in  the  following  remarks. 


Remarks  III, 2; 

(a)  Suppose  that,  in  addition,  the  maps  F,  F^  and  F2  are  also  linear; 
then  (I+GKF)  ^  and  [ I+GK0 (F.+K, F, ) ]  ^  are  the  differential  sensitivity 
functions  (see  equn.  (III. 8))  of  the  feedback  systems  shown  in  Fig.  1.1 
and  Fig.  III. A,  respectively.  Thus  eqn.  (III. 10)  exhibits  a  relation 
between  these  two  differential  sensitivity  functions. 

(b)  In  Lhe  special  case  where  G,  K,  F  are  represented  by  some  scalar 
transfer  functions,  eqn.  (III. 10)  reduces  to 


_ [l+g(s)k(s)f (s)1  _ 

[l+g(s)k2 (s)  •  (^(sHk^s^Cs))  ]  1 


k2(s)ki(s) 

k(s) 


(HI. 11) 


Hence,  by  appropriately  designing  k(s) ,  k^(s) ,.  k0(a) ,  consistent  with  other 
requirements,  we  can  make  the  feedback  system  shown  in  Fig.  1.1  either  more. 
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or  less  sensitive  (to  plant  perturbations,  over  the  freque.;»_y  band  of 
interest)  than  the  one  shown  in  Fig.  III. 4. 

(c)  For  a  recent  discussion  of  using  local  feedback  to  design  an  audio 
power  amplifier,  see  [421. 

B .  Desensitization  and  Feedback  Perturbations 

Proposition  ill. 3  below  derives  the  exact  relation  between  the  relative 
change  in  the  closed-loop  system  input-output  map  (due  to  changes  of  the  plant 
G  and  the  feedback  F)  and  the  relative  change  In  the  feedback  F,  thus  makes 
clear  the  tradeoff  between  the  sensitivities  of  the  closed-loop  system  with 
respect  to  the  plant  and  to  the  feedback. 


!.3  (Desensitization 


sack  pertur 


Consider  the  nonlinear ,  feedback  system  S  shown  in  Fig.  1.1  and  described 

by  eqns,  (I,l)-(1.9),  where  the  plant  G  is  perturbed  and  becomes  G.  Let  the 

feedback  map  F  be  perturbed  and  become  F  :=  F4-AF.  Let  H  :=  GK(I+FGK)  : 

**  'v  *-  •«  -yr  — ~  -*«•***« 

+<^lL  and  H  GK(I+FGK)  ^  =  H  +  AH  :  be  well-defined  nonlinear, 

e  (p  ~yr  •*-  ~  ~  ~y r  ~y r  e  fG 

causal  maps  (thus  AH  includes  the  effect  of  plant  and  feedback  perturbations). 
~yr  ■  - 

Suppose  that 

(al)  F:  ^  is  linear; 

(a2)  F  ^  and  a~°  weH“defined,  causal  maps; 

(a3)  GK  and  (I+FGK)”1  are  C1  maps. 


AH;  (\  [I+D(GtO-F]  ida-l}-F"--AF,  on  U 

-vr-  -yr  ~  ~  -  ~  fe 


(III. 12) 


where  th‘h  Ffechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+aAr)  with 
hr  -AF*  H^r ,  r  G  ^  and-  a  €  (0,1-]  . 


Proof  of  Proposition  III.'):  see  Appendix. 


'h 

1  ;| 


if* 


Remarks  III. 3; 

(a)  Note  that  if  we  choose  to  desensitize  the  closed-loop  system  with  respect 
to  the  plant  G  by  making  the  inverse  linearized  return  difference  [I+D(GK)*F]  ^ 
"small"  over  some  neighborhood  of  ^  the  class  of  inputs-  of  interest,  as  is 
suggested  by  eqn.  (III. 4),  then  \  (T.+D(GK)  *F]_1da -  I  -I  and  by  eqn.  (III. 12), 

,  yo  ' . 

AH  *H  -  -F  *AF  on  il,  :=  H  £  ,  .  Thus,  the  relative  change  in  H 
is  approximately  equal  to  the  relative  change  in  the  feedback  F;  consequently, 
the  closed-loop  system  is  insensitive  to  the  plant  perturbations  but  sensitive 
to  the  feedback  perturbations. 

(b)  In  the  special  case  where  G,  K,  F  are  represented  by  some  scalar  transfer 

functions,  eqn.  (III. 12)  reduces  to  the  classical  result:  over  the  frequency 

Ah  /h 

band  of  interest,  if  |l+g(jto)k(jo)) f(jw)  |  »  1,  then — -  -1. 

(c)  It  is  often  advantageous  to  trade  the  insensitivity  with  respect  to  the 
feedback  map  F  for  the  insensitivity  with  respect  to  the  plant  G,  since  the 
feedback  F  is  usually  operated  at  a  low  power  level  and  hence  can  be  built 
with  inexpensive,  high  quality  components. 

C .  Desensitization  and  1 not  ah  ility 

It  is  well-known  (see  e.g.  [14,  p.  141-143])  that,  for  most  linear, 
time-invariant,  single-input,  single-output  feedback  systems,  the  closed- loop 
system  stability  requirement  imposes  an  upper  bound  on  the  system  loop  gain,  thus 
the  stability  requirement  Limits  the.  achievable  densitization  of  feedback. 

We  show  below  that  such  a  constraint  still  holds  for  a  large  class  of  linear, 
t ime- invariant ,  multi-input  multi-output  systems. 

Gonsider  the  feedback  system  S  shown  in  Fig.  1.1  where  K,  G  and  F  are  represented 


n .  xn  n  xn . 

by  kM  S  m  1  °,  G(s)  e  ]R(s)  0  \  in  G.® 

o 


n  xn 
o  o 


,  respectively  where  k  S  ®+  .  To 
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I 


achieve  desensitization  with  respect  to  the  giver,  plant  G(s)  by  feedback,  we  may 
choose  k  Gl+  as  large  as  possible  so  that  the  maximum  singular  value  of  the 
matrix  [I+kG(ju))M)  ^  be  much  less  than  1  over  the  frequency  hand  of 
interest.  However,  stability  considerations  often  impose  an  upper  bound  on 
the  allowable  k's.  More  precisely,  we  have  the  following  proposition. 


Proposition  III. 4  (besensitization  and  instability) 

Consider  the  feedback  system  3  shown  in  Fig.  1.1,  where  K,  G,  F  are 
n.xn  n  x»  n  xn 

represented  by  kM  €  TR  1  0  ,  G(s)  <=  It(s)  °  ,  I  6  I  °  °,  respectively,  with 

k  >  0,  and  SK-»dct[I+k  G(s)Mj  1  constant.  Assume  tiuit^  Vi  =  l,2,...,n  , 
and  Vj  =  1,2,. . . ,n^, 


3[d  (s)]  -  »ln  (s)l  >  3 


(III.  1/4) 


n.  ,  ...  R  xn. 

where  -j-1  is  the  (i,j)  element  of  G(s)  £TR(s)  0  1  and  3[p(s)]  denotes  the 

ij 

degree  of  the  polynomial  p(s).  Then,  for  k  sufficiently  large, 
det[I+kG(s) *M]  has  C+-zeros  with  real  parts  which  tends  to  +°°  as  k  ■+  °°. 


Proof  of  Proposition  III. 4:  see  Appendix. 


Remarks  III. 4 : 

(a)  Since  det [I+kG(s)M]  is  equal  to  the  ratio  of  the  closed-lcop  sytsem 
characteristic  polynomial  to  the  open-loop  system  characteristic  polynomial 
(see  e.g.  [18]),  Proposition  III. 4  states  a  condition  under  which  the  closed- 
loop  system  becomes  unstable  for  k  sufficiently  large. 

-(fr)  When  ni  =  n0  =  1>  i-e-»  single-input  single-output  case,  Proposition  III. 4 
reduces  to  the  classical  result  which  can  be  easily  proved  by,  e.g.,  the  root 
locus  method  (see  e.g.  [14,  p.  141-143)). 


III. 2  disturbance;  attenuation 


All  physical  systems  operate  in  some  environment  where  they  are  subjected 
to  some  "uncontrollable"  disturbances.  If  we  knew  exactly  these  disturbances, 
then  te  could  program  (in  advance)  the  system  inputs  such  that  the  effect  of 
these  disturbances  be  cancelled  out.  However,  in  most  real  systems,  there 
is  either  no  complete  knowledge  of  such  disturbances  (temperature,  wind, 
wear,  load  changes,  etc.)  or  the  cost  of  measuring  them  and  compensating 
for  them  is  prohibitive;  hence  such  "open-loop"  design  based  on  cancellation 
is  not  practical  and  we  have  to  re.-jrt  to  feedback.  The  analysis  below  shows 
exactly  what  feedback  can  achieve  for  disturbances  attenuation. 

Consider  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 
by  eqns.  (1.1)— (1.9)  but  subjected  to  some  additive  external  disturbances 
as  shown  in  Fig.  III. 5  where 

d^(*)  is  the  system- input  disturbance, 
d  (•)  is  the  plant-input  disturbance, 

g  ~  ~ 

dQ ( • )  is  the  system-output  disturbance, 
d ^ ( • )  is  the  feedback-path  disturbance. 

It  is  intuitively  clear  that,  in  general,  an  error-driven  feedback 
system  such  as  the  one  shown  in  Fig.  III. 5  cannot  attenuate  the  input  dis¬ 
turbances  d  (•)  and  the  feedback-path  disturbance  df(*),  since  such  feedback 
systems  cannot  distinguish  the  system-input  disturbance  d^(‘)  from  the  system  input 
r(*)  and  the  feedback  path  disturbance  d^(*)  from  the  system  output  y(’).  Indeed, 
as  seen  from  Fig.  III. 5,  the  error  signal  e(*)  is  affected  by  the  corrupting 
signals  d^  and  d^;  hence  e(*)  cannot  drive  the  plant  as  desired  (in  some  cases, 
judicious  filtering  may  alleviate  such  problems).  Nevertheless,  we  expect  that 
feedback  can  reduce  the  effect  of  plant-input  and  system- output  disturbances 
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on  the  system  output;  indeed  such  effects  could  be  modeled  by  some  appropriate 
plant  perturbations,  and  their  effect  on  the  system  output  has  been  shown, 
in  sec.  III.l,  to  be  reducible,  by  feedback. 


The  propositions  below  evaluate  exactly  the  effects  of  the  disturbances 

d^,  dQ,  d^,  d^  on  the  system  output  y(*)-  Note  that  unlike  the  linear  case, 

the  effect  of  the  disturbance  d^  (a  =  i,o,f,g)  on  the  system  output  y(*)  is 

not  given  by  H  .  (d  ) ,  where  H  ,  :  d  ^  y  is  calculated  when  r  and  all  the 

-  b  J  ~yd  a  *  ~yd  a-  3 

3  a  3-  ct 

other  disturbances  are  set  to  zero. 


Proposition  III. 5  (System-output  disturbance,  feedback-path  disturbance 
and  feedback) 

Consider  the  nonlinear,  feedback  jystem  shown  in  Fig.  Ill, 5  and  described 
by  eqns.  (I.l)-(1. 9) .  Let  Gu  :=  Gu+d  and  Fy  :=  F,(y+d.) .  Suppose  that 

(al)  F:  ^  -*•  ^  is  linear; 

(a2)  GK  and  (I+FGK)"1  are  C1  maps. 

M  *v«n<v 

U. t.C. 

(i)  if  dQ  j-  0  and  d^  **  d^  =  d^  »  0,  then  Vr  £<^, 

Ay  :=  GK(I+FGK)"1(r)  -  GK(I+FGK)_:L(r) 

=  f  [I+DCGKiTr^Ct-d  (III. 15) 

Jo  ~  ~  ~  0 

where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+aAr)  with 
Ar  =  F*d  and  a  £  [0,1]. 

(ii)  if  do  ^  0,  d^  0  and  =  d  =  .0,  then  Vr  £  ^ 

Ay  :=  GK (I+FGK) "*1  ( r )  -  GK( I+FGK) _1(f) 

'V'U'V  iv  'V'V'* 

=  {(  [I+D(GK) *FJ-Ida -  l}*df  (III. 16) 

JQ  ~  ~  t 

where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  ^ (r+aAr)  with 


Proof  or  Proposition  III. 5:  see  Appendix. 


Proposition  III. 6:  (Plant-input  disturbance  and  feedback) 

Consider  the  nonlinear,  feedback  system  shown  in  Fig.  III. 5  and  described 
by  eqns.  (I.l)-(1.9),  where  d^  =  do  =  dj.  =  0.  Let  Gu  :=  G(u+d  ).  Suppose 


!  1 

:  f 


(al)  F:  ^  is  linear; 

(a2)  GK,  (I+FGK)"1  are  C1  maps. 


ir 

k 


Then ,  VrG^ 


Ay  :=  GK(I+FGK)_1(r)  -  GK(I+FGK)“1(r) 
fl  „  _i  A 
=  (\  [I+D(GK) *F]  da}* [1  DG(u+3d  )d$]*d 

Jo  “  Jo  *■  8  * 


(III. 17) 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+aAr)  with 
Ar  =  F[G (u+d  )-G(u)],  u  :=  K( [+FGK)_1r ,  and  a  S  [0,1]. 


Proof  of  Proposition  III. 6:  see  Appendix. 


Proposition  III. 7:  (System- input  disturbance  and  feedback) 

Consider  the  nonlinear,  feedback  system  shown  in  Fig.  III. 5  and 
described  by  eqns.  (r.l)-(1.9),  where  d^  =  dQ  *  d^  *  0.  Suppose  that  F,  GK 
and  (I+FGK)  1  are  C1  maps,  then  Vr  £  ft  t 


Ay  ;=  GK ( I+FGK) ~1(r+d.)  -  GK ( I+FGK) -1(r) 
-  —  ^  ~  ^ 

-  \  D(GK)[I+DF*D(GK)]  da*d 


(III. 18) 


;  i  i 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+ad. )  and  DF 

»»  'V'WN  J. 

is  evaluated  at.y.GK [I+FGK?]  ^(r+ad^)  with  a  £  [0,1]. 

Proof  of  Proposition  III. 7;  Follows  directly  from  Taylor's  expansion  theorem 
[19,  p.  190]. 
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Comments  on  Propositions  III.5-III.7: 


(a)  Eqns.  (III.15)-(III. 18)  show  exactly  how  feedback  can  reduce  the  effects 
of  various  external  disturbances  on  the  system  output.  Note  that,  by  eqns. 
(III. 15)  and  (III. 16),  simultaneous  disturbance  attenuation  of  dQ  and  d^  is, 
in  general,  impossible. 

(b)  In  the  special  case  that  G,  K  and  1'  are  linear,  the  effects  of  the  dis¬ 
turbances  d  ,  dc,  d  ,  d,  on  the  system  output  reduce  to  (I+GKF)  ^d  , 

o  t  g  1  -  ~~~  o 

[ (I+GKF)_1-I]d. ,  ( I+GKF) _1Gd  and  GK(I+FGK)_1d, ,  respectively.  Note  that  in 
this  case,  those  disturbance-output  maps  are  related  by,  with  obvious 
notation 


H  .  -  I  +  H  . 

~ydQ  -  -ydf 


I-H,KF=I-H  ,  F 

~  •wYQ  •»  -vcl ,  *• 

g  i 


(III. 19) 


III. 3  LINEARIZING  EFFECT  [20](?) 

It  is  often  required  that,  the  map  from  the  system  input  to  the  system 
output  is  as  linear  as  possible,  e.g,  HiFi  amplifiers,  telephone  repeaters, 
measuring  instruments,  pen  recorders,  etc.  How  to  design  such  a  system  which 
uses  some  inherently  nonlinear  plant  is  an  important  problem.  From  the 
discussion  in  section  II,  we  know  that  if  the  feedback  map  F  is  linear  and 
if  the  inverse  loop  gain  is  small,  then  the.  closed-loop  system  input-output 
map  will  be  close  to  a  linear  map.  Thus  we  expect  that  feedback  has  a 
linearizing  effect  on  an-  otherwise  nonlinear  system.  To-  make  this  idea 
precise,  we  first  introduce  the  concept  of  nonlinearity  measure. 

A  Nonlinearity;  pleasure 

Let  ££  be  an  extended  normed  (input)  space.  Let  ^  be  an  extended 
semi-normed  (output)  space.  Let  ^  -  (N:^/e  -»■  jjfj  ,  N  is  gausal?  nonlinear). 


LetX  -  {L:  %i  °U  |b  is  causal,  linear}.  Now  consider  N  £  ^  and  fC  V  ( 

G  (7  C  —  0 

a  set  o£  inputs  cf  interest,  intuitively,  the  degree  of  nonlinearity  of  N, 
when  N  is  driven  by  u  £  V,  may  be  measured  by  the  error  |Nu  -  Lu|  for  u  £  V, 
where  L  £X  is  a  "best"  linear  approximation  of  N  over  V.  More  precisely, 
we  introduce  the  following  definition. 

Definition  HI. 8  (Nonlinearity  measure) 

Let  N  £  V C  'ZL  and  T  6,T.  The  nonlinearity  measure  of  N  over 
with  respect  to  T  is  the  non-negative  real,  number  defined  by 

6  (N ,*?/),  :=  inf  sup  |Nu~Lu|  .  (III. 20) 

1  ~  \&i  \£V  -  ~  T 

Remarks  III. 8: 

(a)  L  is  tjlus  said  to  bo  a  best  linear  approximation  of  N  over  v  iff  L 

is  a  minimizer  of  (TTT..20),  i.e.,  5  (N,V)  =  sup  |Nu  - 

1  '  i»sr '  '  T 

(b)  In  the  case  where  i.s  a  semlnormed  space,  we  then  have  the  nonlinearity 
measure  of  N  over^  with  respect  to  supQ'  (typically,  sup 3^  =  “)  and  eqn.  (III. 20) 
becomes  <S(N,V)  =  inf  sup  |Nu~Lu|. 

(c)  The  well-known  describing  function  (see  e.g.  [21,22])  is  the  best  linear 
approximation  of  a  nonlinear  operator  with  respect  to  our  nonlinearity  measure 
(III. 20)  provided  that  0/ ,  the  class  of  inputs,  is  suitably  defined.  Recall 

that  the  criterion  which  the  describing  function  method  uses  to  find  a  best  linear 

approximation  L  of  a  nonlinear  system  N  is  to  minimize  the  mean  square  error 
1  2 

lim  —  l  [ (Nu) (t)-(Lu) (t) ]  dt  over  a  class  of  inputs  u(*)  (usually 
T-*»  •'O'* 

u(t)  =  asinwt,  a  >  0,  u»  >  0,  and  thus  L  depends  on  the  parameters  a,  w) .  To 
•see  the  relation  between  the  describing  function  and  our  nonlinearity  measure, 
let  a  >  0,  w  >  0  be  given,  let  *V  be  the  singleton  {a  >sin  tot)  and 

Hq  /Q\ 

%  =  {y(-):  3R++m  |y(*)  is  asymptotically  -^—periodic ^  ' }  be  equipped  with 


t*he 


semi-norm 


:=  [lim 


then  a  best  linear  approximation 


to  the  nonlinear  system  N  according  to  our  definition  I II. 8  is  a  minimizer 

1  fT  2 

of  lim  —  l  [(Nu) (t)-(Lu) (t) ]  dt  which  is  precisely  the  describing  function 
X-k»  J.  0 

of  N  with  respect  to  the  inputs  u(t)  =  asinwt.  Note  that  in  this  case, 
the  minimizer  of  (III.2C)  (i.e.  the  describing  function  of  N  with  respect  to 
u ( * ) )  is  parametrized  by  a  and  us. 

(d)  With  the  framework  of  extended  spaces,  we  can  discuss  the  nonlinearity 
measure  of  a  nonlinear  system  over  a  bounded  time  interval,  say,  [ 0 ,T ] .  . 

Note  that  a  nonlinear  system  N  may  have  its  nor.lLnearity  measure  =  0, 

VT  <  T*  £  O,  but  6  (N,*?0  ^  0  for  T  >  T*,  simply  because  N  is  operating 

I  - 

within  the  linear  range  of  its  characteristics  before  time  T*. 

(e)  At  the  cost  of  some  complication,  the  class  of  nonlinear  operators 
under  consideration  can  be  extended  to  include  the  nonlinear  dynamical 
relations. 

(f)  Other  nonlinearity  measures  may  be  defined,  e.g.,  we  can  define 


|Nu-L«u  I T 

6  (N/VO  *  inf  sup  — r-r -  .  Note  that  such  nonlinearity  measure  does 

T  ~  LG5C  UGV  lu'T 

uT#) 


satisfy  all  the  remarks  mentioned  above  and  all  the  properties  stated  below. 
However,  we  have  not  been  able,  to  obtain  results  similar  to  the  Theorem  III. 14 
below. 


Properties  of:  the  -Nonlinearity,  Measure.  6„(N,£0 
Proposition  ill. 9: 

If  N2  =  21  +  L1  for  some  then  ^(N.^)  =  ^-2’^’  VT  6  0'', 

VVCVl. 

e 


Proposition  III. 10: 


Proposition  IT.I.ll: 


Suppose  that  VT  €  ^  P  JU.  is  a  normed  space. and  that  NO  =  0.  U.t.c.  if 

'-1  gC‘ 

,  (Q\ 

N  is  Frechet  differentiable  at  0,  then  VT  c  J, 

* 

0  _<  6T(N,B  (O;0))  <  sup  j Nu-DN (0)  *u |  -*■  0,  as  8  -»■  0  (III. 21) 

~  ti£BT(0;6)  "  " 

where  B_(0;S)  :=  {u€  U.  I  |u|_  <  8)  end  L)N(O)  denotes  the  Frechet  derivative  of 
T  e 1  1  T —  - 

N  at  0. 


Proposition  III. 12: 

bet  If  C  ti  be  the  set  of  inputs  of  interest.  If  for  some  L  6  , 

Nu  =  bu,  Vu  <=  Y,  tlien  (N,"!/)  =  0,  VT  <=  Tl  In  particular,  if  N  6  X , 
then  6  (N,V)  »  0,  VT  €  S',  WC 


Proposition  III. 13: 

bet  be  the  set  of  inputs  of  interest,  bet  be  specialized  into 

the  class  of  continuous , ^ ^  linear,  causal  operators  mapping  X(.  into  %  • 

e  /e 

Suppose  that 


(al)  VT  P^t^  is  a  Banach  space; 

(a2)  VT  VCti.  is  bounded,  i.e.  sup  |u|  < 

e  \0V  1 

(a3)  VT  €  3",  38  >  0  such  that  VD  ^(OjS)  :=  {u^f-ij  |u|T_<  8). 

U.t.c.  if  for  some  T  G(T,  6^, (N,*Zr)  =  0,  then,  3lj*  e  £such  that 

|Nu-b*u|T  =  0,  Vu  S  V.  (III. 22) 


Proofs  of  Propositions  III. 9-111. 13:  see  Appendix. 

Comments  on  Propositions  III.9-III.J3 : 

(a)  Proposition  Hi. 9  states  the  obvious  fact  that  if  two  nonlinear,  causal 
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the  same 


operators  differ  by  a  linear  causal  operator,  then  they  must  have 
nonlinearity  measure.  It  is  also  intuitively  clear,  from  a  perturbational 
viewpoint,  that  if  a  linear,  causal  operator  is  subject  to  some  nonlinear 
causal  perturbation,  then  the  nonlinearity  measure  of  the  perturbed  nonlinear, 
causal  operator  must  be  the  same  as  that  of  the  nonlinear  perturbation. 

(b)  Proposition  III.  10  emphasir.es  the  fact  that  the  nonlinearity  measure 
depends  on  the  class  of  inputs  we  art  considering:  the  larger  the  class  of 
inputs  we  consider,  the  greater  the  nonlinearity  measure  of  operator  N. 

(c)  Proposition  III. 11  Is  another  way  of  stating  the  well-known  fact  that 
(since  NO  =  0)  the  best  local  linear  approximation  of  a  Frechet  differentiable 
nonlinear  operator  N  at  the  operating  point  0  is  the  Frechet  derivative  of  N 

•s* 

at  0.  Note  that  by  cqn.  ( L L L . 2 1 ) ,  »\l.(N,ii.J,(0;(i))  *>■  0  as  (3  *v  0,  i.e.  N  behaves 
locally  like  a  linear  operator  as  we  expected. 

(d)  Proposition  III. 12  states  that  <5,j.(N,V)  satisfies  the  natural  requirement 
,"or  a  nonlinearity  measure,  namely,  if  N  behaves  as  a  linear  causal  operator 
over  the  class  of  inputs ‘Z''  in  the  time  interval  [0,T]  CS’',  then  6^,(N,^)  =  0. 

(e)  With  some  mild  technical  assumptions,  proposition  111.13  establishes 
the  followings  desirable  property  of  <$-(N ,?f) :  if  <$T(N ,10  =  0,  then  N 
behaves  like  a  linear,  causal  operator  over  V  in  the  time  interval  [0,Tj  C^T. 
Note  that  if  6T(N,V)  »  0,  then  6T,(N,*n  -  0,  VT'  <  T. 

Linearizing  Effect  of  Feedback 

With  the  nonlinearity  measure  defined  in  eqn.  (Ill .20),  we  now  can  make 
precise  th?  idea  that  feedback  has  a  linearizing  effect  on  an  otherwise 
nonlinear  system. 

wote  that  the  nonlinearity  measure  defined  in  (111.20)  allows  us  to  compare 
nonlinear  systems  by  their  degree  of  nonlinearity.  However,  a  meaningful 


comparison  requires  careful,  choice  of  the  sets  of  inputs  since  the  nonlinear¬ 
ity  measure  depends  on  the  set  of  inputs  we  are  considering.  From  an  engi¬ 
neering  point  of  view,  we  are  interested  in  comparing  systems  which  produce 
desired  outputs  (e.g.,  signals  within  certain  frequency  band  or  dynamical 
range).  Hence  in  the  following  discussion  of  the  linearizing  effect  of 
feedback,  we  shall  compare  the  nonlinearity  of  measure  of  a  nonlinear  plant 
and  of  a  feedback  system  which  includes  such  a  plant;  we  shall  choose  a  set 
of  inputs  for  each  system  so  that  both  systems  produce  the  same  set  of 
desired  outputs. 

Consider  the  nonlinear  feedback  system  S  shown  in  Fig.  1,1  and  described 
by  eqns.  (T .1)— (1.9) ,  except  now  that 


'?/  is  an  extended  somlnormed  space 


% 


(III. 23) 


Let  ^  e  C;c  be  the  set  of  desired  outputs.  Let  ^  e  C 

be  the  set  of  system-inputs  r(0  such  that  H  OL ,  =• V. 

-yr  d,e  /d,e 

Let  fy'j  e  be  the  set  of  plant-inputs  u(*)  such  that 

Gf/.  =  U.  . 

~  d , e  ®u,e 

Now  we  have  the  following  theorem: 


(III. 24) 


Theorem  III, 14  (Linearizing  effect  of  feedback) 

Consider'  the  nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  described 

by  eqns.  (I.1)-(I,9)  and  (III.23)-(ITI.2A) .  For  some  T  6  let  L*  G  / 

— G 

be  a  best  linear  approximation  to  G,  i.e. 


MG =  sup  I Gu-L*u I  (III. 25) 

~  a,e  x£U.  ~  ^  1 

d,e 

Assume  that  F:  and  aro  linear ,  causal  and  that  the  linear 

"k 

map  (I+L-KF)  has  a  causal  inverse,  then 
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where  H  :=  GK(I+FGX)  ^  is  the  closed-loop  input-output  map  and 


P 


1  <I+i-c^L')_1ylT 

s  up - — ry-t - 

y<=%  'y<T 

yT  i4  o 


with 


<7Ud,u 


(III. 27) 


Proof1  of  Theorem  III.  14:  see  Appendix. 


Remarks  III. 14: 

(a)  In  a  design  problem,  given  some  (5  £9?  together  with  its  best  linear 
approximation  over  e  with  respect  to  some  T  E  O't  if  one  designs  K,  F 
such  that  p  be  much  less  than  i,  consistent  with  other  requirements,  then 

by  eqn.  (LIT.. 26),  6,^ ( U y r  >  c>)  ^  (1) »  i.o.  for  the  class  of  Inputs  under 

consideration  and  for  the  time  interval  of  interest,  the  closed-loop  system 
is  much  closer  to  a  linear  system  than  G  itself.  This  result  clearly 

*v 

exhibits  the  linearizing  i.Ei  -i.  feedback. 

(b)  Note  that  p  is  defined  via  the  inverse  linearized  return  difference 

operator  (I+L^KF)  ^  (when  we  break  the  Loop  after  the  plant  G) :  since 

the  nonlinear  plant  G  can  be  thought  as  a  linear  plant  being  subject  to 

some  nonlinear  perturbation  G-L*,  and  we  know  that  (see  eqn.  (ill. 8) or  [431 )  as  a 
r  r— -■  —  *-0 

first  order  approximation,  the  effect  of  a  nonlinear  perturbation  on  the  otherwise 

*  ,  -X 

linear  closed-loop  system  is  reduced  by  the  factor  (I+L  RF)  by  feedback. 

(c)  If  L*,  K,  F  are  linear  and  time-  invariant,  thus  represented  by  transfer 
function  matrices  L*(jw),  K(ju>) ,  P( Jo») ,  respectively) ,  then  p  «  1  If  the 

c 

maximum  singular  value  of  fT+L*(1w)K(i«)F( iw) ]  is  small  over  the  frequencies 

w 


of  interest. 


Example  III.l  ( Single- inpu t  sin gle-outp u t  memorvless  system) 

Consider  the  nonlinear,  focc!back  system  S  shown  in  Fig.  1.1,  where  G  is 
characterized  by  the  p Lecewi.se- L intar  function  shown  in  Fig.  III. 6,  K  and  F 
are  represetned  by  constant  gains  10  and  1,  respectively.  It  is  easy  to 
show  that  the  closed-loop  input  -output  map  H  is  characterized  by  the 
piecewise-linear  function  shown  jn  Fig.  III. 7.  Now  let  us  consider  the  case 
where  &  ~  (y(*):  1R+  -V1R  |  I  y  1  Jl  0  •  8 } ,  then  the  correspending  ^  e  =  {»(*): 
1R+->-]r|  |u|M_<  1.2}  and  ^  “  fr:  1R+->-]r|  |r  | ^ _<  0 . 9 2 } .  A  straightforward  minmax 

calculation  shows  that  the  best  linear  approximation  1,^,  of  G  is  a  constant 
gain  of  0.6  and  the  nonlinearity  measure  of  G  is  <$_(G,2(,  )  =*  0.12,  VT  GT; 

—  1  v  Ojfi 

more  precisely,  6  (G,tA  )  =  sup  |Gu-0.6u|  =  0.12.  Similarly, 

1  ~  d,c  ue^j  ~  » 1 

6.  (H  )  =  sup  |ll  r-~r|  l  ”  .  VTGd.  Thus  the  nonlinearity 

i  ~yr  u,c  ~yr  /  ■",  i  / 

measure  of  G  has  hefin  reduced  by  7  by  feedback.  Note  that  p  *  Y~6~6xi0  *  J' 

i.e.  for  this  example,  the  equality  holds  in  eqn.  (111*26).  The  best  linear 

approximations  of  G  and  11  are  shown,  by  the  broken  lines,  in  Fig.  HI. 6 
—  ~yr 

and  Fig.  III. 7,  respectively.  To  further  illustrate  the  linearizing  effect 

of  feedback,  we  drive  the  nonlinear  plant  G  with  u  =  1.2  sin <ot  and  the  closed- 

loop  system  GK(I+FGK)  ^  with  r  =  0.92  sin  wt.  The  corresponding  (open-loop 

system)  output  y^  and  the  (closed-loop)  output  y  are  shown  in  Fig,  III. 8. 

In  general,  it  is  quite  difficult  to  calculate  the  nonlinearity  measure 

<$T  of  a  nonlinear  dynamical  system  and  to  obtain  the  best  linear  approximation 

of  such  a  system.  However,  for  a  given  nonlinear  plant  G,  we  may  'illustrate 

*■* 

the  linearizing  e.ffect  of  feedback  by  computing  the  closed-loop  system  output 
with  respect , to  several  different  compensator  gains  while  the  closed-loop 
system  is  driven  by  some  Lest  signals.  Examples  II. ,1  and  II. 2  in  section  II 
clearly  exhibit  the  linearizing  effect  of  feedback  on  nonlinear  dynamical 
systems.  Note  that  the  higher  the  compensator  gain  is,  the  more  linear  the 
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closed-j.oup  system  appears  to  be  as  we  expected  from  the  result  of  theorem 
III.  14  (since  p  defined  in  eqn.  (TIT. 27)  decreases  as  the  gain  of  K  increases). 

III. 4  ASYMPTOTIC  TRACKING  AND  DISTURBANCE  REJECTION 

One  important  application  of  feedback  in  control  is  the  servomechanism 
design  which  aims  at  asymptotic  tracking  and  asymptotic  disturbance  rejection. 
Let  us  consider  the  asymptotic  tracking  problem.  Prom  the  discussion  of 
generalized  Black's  formula  in  sec..  II,  we  know  that  if  we  let  F'  =  T  in  the 
nonlinear,  feedback  system  S  shown  in  Fig.  1.1  and  if  we  make  the  "forward-path 
gain"  sufficiently  large,  then,  asymptotically,  the  output  y(*)  will  be 
approximately  equal  to  the  system  input  r(*>.  Thus  we  might  intuitively 
guess  that  we  can  obtain  perfect  asymptotic  tracking,  i.e.  zero  steady  state 
error,  by  requiring  the  "forward-path  gain"  be  infinite  the  frequency  of 
the  system  inputs.  This  turns  out  to  be  correct.  Indeed  in  the  classical 
servomechanism  design  [23],  an  integrator  is  required  in  the  compensator  in 
order  that  the  system  output  track  amp  signals  with  zero  steady-state  error. 
For  multi- Input,  multi-output  systems,  such  a  design  principle  has  also  been 
proven  to  be  correct  for  linear  (see  e.g,  [24,25,26])  as  well  as  nonlinear 
cases  (see  e.g.  [27]). 

HI.  5  STABILIZATION 

Stability  is  a  primary  concern  of  engineers  since  an  unstable  system 
i«r  obviously  useless.  However-,  there  are  many  inherently  unstable  systems 
&4ch  as  rocket  booster  systems,  nuclear  reactors,  some  chemical  reactors, 
etc.  which  ate  useful  in  practice  and  hence  must  be  stabilized.  Note  that 
Any  open-loop  stabilization  scheme  is  doomed  to  failure  in  practice  because 
it  is  based  on  some  kind  of  cancellation  which  will  eventually,  fail  as  a 


result  of  changes  in  element  characteristics,  effects  of  environment,  etc. 

Hence  feedback  seems  to  he  the  only  way  out. 

Many  researchers  have  studied  the  use  of  feedback  in  stabilizing  unstable 
systems.  For  lumped,  linear,  time-invariant  systems,  it  has  been  shown  that 
a  constant  state  feedback  (fee  e.g.  [28,29])  or  a  dynamical  output  feedback 
(see  e.g.  [30])  can  stabilize  an  unstable  system;  recently,  Youla  et.  al. 

[31]  gave  a  characterization  of  all  stabilizing  feedback  controllers,.  For 
lumped,  linear,  time-varying  systems,  a  time-varying  state  feedback  can  be  obtained 
(see  e.g.  [32,38,39,40,41])  to  stabilize  an  unstable  system.  For  distributed, 

linear,  time- invariant  systems,  state  feedback  can  also  stabilize  unstable 
systems  (see  e.g.  [ 33 ; 34 ,  chap.  14]).  In  contrast  to  linear  cases,  little 
is  known  about  the  nonlinear  case  except  for  some  limiting  cases.  It 
should  also  be  pointed  out  that  little  is  known  about  how  to  proceed  with 
the  design  of  a,  say,  state  feedback,  stabilization  scheme  so  that  the 
resulting  closed- loop  system  stability  is  very  robust  with  respect  to  changes 
in  the  plant  and/or  the  feedback  map.  In  this  aspect,  for  the  linear  time- 
invariant  case,  singular  value  analysis  has  provided  some  valuable  informa¬ 
tion  (see  e.g.  [44]) . 

IV.  CONCLUSION 

This  paper  has  treated  the  fundamental  properties  of  feedback  for 
nonlinear,  time-varying,,  mul ti-input,  multi-output,  distributed  systems.  We 
observed  that  the  classical  Black  formula  does  not  depend  on  the  linearity 
nor  the  time- invariance  assumptions;  we  used  the  input-output  description 
of  nonlinear  systems  to  actually  generalize  Black's  formula  to  the  nonlinear 
case  (Theorems  II. 1  to  II. 3).  Our  analysis  then  established  achievable 
advantages  of  feedback,  familiar  to  feedback  engineers,  for  nonlinear  systems 


(section  III):  theorem  Ili.l  showed  the  exact,  relation  between  the  changes 


in  the  open-loop  and  closed-loop  input-output  maps  caused  by  nonlinear,  not 
necessarily  small,  plant  perturbations;  propositions  TII.5-III.6  calculated 
the  exact  effect  of  various  additive  external  disturbances  on  the  output  of 
a  nonlinear  system;  theorem  111.14  related  the  nonlinearity  measure,  of  a 
nonlinear  plant  and  that  of  a  feedback  s).,tem  including  such  a  plant; 
sections  III. 4  and  III. 5  briefly  reviewed  the  use  of  feedback  to  achieve 
asymptotic  tracking  and  disturbance  rejection,  and  to  stabilize  unstable 
plants,  while  references  are  given  for  more  detailed  discussion.  These 
results  showed  precisely  how  to  achieve  desensitization,  disturbance  attenua¬ 
tion,  linearizing,  asymptotic  tracking  and  disturbance  rejection  by  feedback 
in  nonlinear  systems. 

The  benefits  of  feedback  do  not  come  without  limitations  or  tradeoffs 
as  propositions  111.2-111.5  showed:  proposition  III. 2  showed  the  relation 
between  desensitization  and  feedback  structure;  proposition  III. 3  showed  the 
tradeoff  between  the  sensitivities  of  a  nonlinear,  feedback  system  with 
respect  to  the  perturbations  on  the  plant  and  on  the  feedback  map;  proposi¬ 
tion  III. 4  showed  that  stability  requirements  restrict  the  achievable  desen¬ 
sitization  effect  by  feedback;  proposition  III. 5  showed  the  tradeoff  between 
the  output1  disturbance  attenuation  and  the  feedback-path  disturbance  attenua¬ 
tion.  Note ’that,  due  to  the  lack  of  appropriate  language  and  tools,  we  did 
not  discuss  the  tradeoff  between  the  gain  and  bandwidth.  Consequently,  we 
did  hot  explore  the  limitations  on  the  benefits  achievable  by  feedback 
imposed  by  the  plant  with  fixed  gain  and  and  bandwidth  (in  the  context  of 
the  Bode  design  method  [45],  the  gain-bandwidth  of  a  given  active  device 
imposes  an  upper  bound  on  the  return  difference  over  a  specified  bandwidth)-. 


Also  note  that  we  have  only  treated  deterministic  systems,  i.e.  no  stochas¬ 
tic  models  were  introduced  for  noise,  perturbations,  element  variations, 
etc.  Thus,  in  particular,  we  did  not  mention  the  well-known  limitation  on 
compensator  gain  caused  by  noise. 

In  clarifying  the  features  of  nonlinear  systems  that  are  required  for 
feedback  to  be  advantageous,  this  paper  will  help  engineers  obtain  better 
understanding  of  nonlinear,  feedback  systems. 
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APPENDIX 


Proof  of  Theorem  II. 2: 

Note  that 

H  :=  GK(I+FGK)_1 
*~yr  ~ 

=  F-1FGK(I+FGK)-1  (since  F  is  invertible) 

=  F_1FGK[(I+(FGK)_1) (FGK)]"1  (since  FGK  is  invertible) 

=  F-1[  I+(l?GK)-1]_1  (A .  1) 

To  estimate  H  r  for  r  G  .  ,  we  consider  first  z  :=  (I+(FGK)  ^r. 

~yr  d,e  -  — ~ 

To  obtain  for  any  T  G^T,  zy,  note  that  r  =  (I+(FGK)  ^]z,  hence 
z,r  =  rT  -  (FGK)  ^z,j,«  Now  the  Lipschitz  constant  [13,  p.  63]  of  the  right 
hand  side,  over  A/  (^  ^ ,  is  v^KFGK)  <  1.  By  assumption  (a3)  ,  the 
successive  approximations  starting  with  -  r  remain  in  e)  forever; 

since  the  contraction  constant  is  <  1,  we  have  that 


|  (FGK)  3-r|T 

i-yt[(fgk)_1] 


(A.  2) 


Thus ,  for  each  T  G  £r', 

l”yrr_-"lr,T  =  l1fl(r"e)"!'1rlT 

=  | F_1[ X+(FGK) _1]“lr-F_1r |T 

_<  X(F_1) | [ I+(FGK)  3]  1r-r|T  (by  assumption  (i)) 

_  |  (FGK)  '-1r| 

<  X(F  l) - — - - (by  (A. 2)) 

"  L-YT[(FGK)  ] 

In  particular,  if  eqn&.  (II. 10)  and  (II .11)  hold,  i.e.  for  T  G  £7  sufficiently 
large, 
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Proof  of  Theorem  II. 3; 

Since  F  is  invertible,  we  have,  from  Fir.  1.1, 

y  =  Hr  =  F-1(r-e) 

~yr 

Hence,  for  T  €3'  sufficiently  large,  Vr  £  ^ 

|Hyrr-flrlT  “  If' L(r-e)-F"1r|T 

<  A(F  ^)|e|T  (by  assumption  (i)) 

=  A(F_1) | (I+FGK)_1r |_ 

•»  ~  •y'x'v  X 

«  |F  r | ^  (by  assumption  (ii))  Q.E.D. 

(since  F  ^  is  linear) 

»  -  [(I+FGK)F]~1r 

=  -  [F(I+GKF)]  ^r  (since  F  is  linear) 

»•  -  ( 1+GK.F)  ~ 1  F_1r 


Proof  of  Corollary  II. 3.1: 


v?"lr  -  rv-o  -  ?"lr  -  -  r1* 


-  -  F“I(I+FGK)-lr 

A*  •. 


Hence  for  T  S  jT sufficiently  large. 


|Hyrr  “  ?_1r  lT  =  lU+GKF)  h  Xr| 


«  -1 
'F  V 


(by  assumption) 


Q.F..D. 


Proof  of  Corollary  II. 3.2 : 

Consider  the  system  S  in  the  sinusoidal  steady  state  (since  the 
closed-loop  system  is  exp.  stable  by  assumption  (a2))  with  input 
r*exp(jwt)  and  error  e«exp(jwt),  where  r,  e  £  (£n.  Then,  by  linearity 
of  F (jw) , 


H  (jw)r  =  F(jw)“J-(r-e)  =  F(.]w)"1r  -  F(jw)_1e 
y 


Hyr(jw)r-F(jw)“1r  -  -F(ju>fle 

-  -F.(ju)"1[(l+F6K)(jw)]"1r 
=  -[ (I+FGK)F] (jw)-^r 


t F( jiu)  (I+GKF)  (jw))  r  (by  linearity  of  F(joi)) 
=  -[  (I+GKF)  (jw)r1F(ju)"1r 


Hence 


|H  (ju>)r-F(jw)~J  r|  =  |  ( (I+GKF)  (Joj) )'1F(j(j)"1r| 


-1 . ,-l 


«  | F( joi)  1  k- |  (by  assumption  (11,21))  Q.E.D. 


Proof  of  Theorem  III.l: 


AH  :=  H  -H 
~yr  ~yr  ~yr 


=  GKd+FGK)"1  -GKd+FGK)"1 


-h  9- 


•-J1- 

Jo 


D (GK)  •  F (  L+D (GK)  •  F ]  ^da*  AH  (r)  +  AH  (r) 


~yor 


~yor 


(since  F  is  linear) 


■  I  <1 


-U 


(l-D(GK)  *F[I+D(GK)  *F]  }da*AH  (r) 


'0 

rl 


yor 


-jij 

*'0 


1 


[  I+D(GK) • F ]  da* AH  (r) 

-  "  ~yor 


Eqn.  (A. 7)  is  true,  Vr  £<^,  thus  eqn.  (ITI.4)  follows. 


Proof  of  Proposition  11 1.2 : 

Note  that 

GK ( I+FGK) ~ 1  =  (I4GKF)“1GK  (since  GK  is  linear) 


and  that 


GK2(I+F2GK2)  1KjU+F1GK2(I+F2GK2)"1K1]  1 

«  GK„ (I+F  GK_)_i( 1+K,F  GK0 (I+F0GK  )~1]~1K1  (since  K 
•••vZ  n  '“Z*'**Z  ~  •ui.'vi. -«»*z  «•  **Z v<*<Z  « X 


=  G.K9U+(F  +K.FJGKJ  K1 


(since  GK, 

-  —  i 


Thus  eqn.  (III. 10)  follows  from  eqn.  (111,9). 


Proof  of  Proposition  III. 3: 

AH  : -  GK( I+FGK) _1  -  GK( I+FGK) _1 
-yr  ~~  — 

«  GK(I+FGK)"1[I+AF*GK(I+FGK)”1]"1  -  GK( I+FGK) 
Evaluating  eqn.  (A. 8)  at  r  £  we  have 

AH  r  « GK ( I+FGK) -1(r+Ar)  -  GK(I+FGK)_1(r) 

~yr  v  'v'w'w 

where 


(A. 7) 

Q.E.D . 


is  linear) 

is  linear) 

Q.E.D. 

(A. 8) 

(A. 9) 
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(A. 10) 


r+Ar  :=  [I+AF*GK(I+FGK)_1]~1r 

Since,  by  assumption  (a3),  GK(I+FGK)  ^  is  a  map,  we  can 
AH^r  by  the  Taylor’s  expansion  theorem  and  obtain 

f1  ~  _i 

AH  r  =  1  D(GK)  •  [ I+F‘D(GK)  ]  dccAr 

~yr  Jq  ~~ 


where  the  Frechet  derivative  D (GK)  is  evaluated  at  (1+FGK) 
DF  =  F  since  F  is  linear. 

Note  that  eqn.  (A. 10)  implies  that 


Ar  =  {[I+AF.GK(I+FOK)-il  ^IJr 

•U  •«#  <V  ..  ^ 

=  -  AF  •  GK  ( I+FGK)  " 1 1 1+AF  •  GK  ( T.4-FGK)  “1  ]“ 1  r 

*V»  «S#  <«W  *V  *V  *W  *V 

=  -AF*GK(l+FGK)“1r 

*S#  ^  ■« 


=  -AF*H 


~  ~yr 


r 


Thus  eqn.  (A. 11)  becomes 


AH  r  =  -(  D(GK)  •  [I+F*D(GK)  ]_1’da,AF,H  r  (since  F  is 
~yr  Jq  —  -  ~  —  ~  -yr 

-  -(  D(GK)*[I+F*D(GK)rlFda*F"1*AF*H  r  (since  I 
•>0  ~  ** . yr 

■  4  D(GK)F*[I+D(GK)*F.],~1daiF'1*AF*H  r  (since 
•%  —  ~  ~  ~  ~ 
rl 


i,-e. 


AH 


{(  [I+D(GK) •F]_1da-l} •F~1,AF*H.  r 
J0  -  ‘ —  ~  ~  ~  ~yr 


-yr 


=  {[  [I+D(GK)F]_;lda-l}  •F~^*AF*H  ,  on  (f? 

Jn  ~  ~~~  ~  ~  ~yr  '•€ 


evaluate 

(A. 11) 
^(r+aAr),  and 


linear)  (A. 12) 

'  is  invertible) 
F  is  linear) 


Since  H  is  inyertible,  we  have 
~yr 


AHyr* irj.  =  {J  [l+iJWlfVll-r"'^?  ,  on  ^ 


Q.E.D. 


Proof  of  Proposition  III. 4: 

For  completeness,  we  first  state  an  algorithm  [36]  which  determines 
the  asymptotic  behavior  of  the  zeros  of  a  polynomial.  This  algorithm  is 
a  direct  application  of  the  Newton's  diagram  (or  known  as  the  method  of 
Puiseux,  see  e.g.  (35,  p.  105]). 

Algorithm: 

Data:  Polynomial  P(s,k)  =  (k)s^  G  K[s] 

where  5  for  X.  =  0,1,2,  ...,n 
m„ 

aj.(k)  =  5^a24kJ  >  k»  «fi'sGR 

a  ^  0  ,  and  ct.  ^  0  ,  VO  <  ^  <  n-1  such  that  m„  >  0 
nm  Hm0  ’  -  -  *- 

n  x, 


Step  1:  Find  i  G  11,  and  q^  G  <J)+,  0  £  p  £  i, where  i,  T^'s,  ^p's  are 


P  P 


such  that 


(i)  i  is  the  largest  integer  such  that  0  =  Tq  <  <  T^; 

(ii)  =  max{niQ,m^, . . .  ,mn) ; 

(iii)  for  0  £  p  £  i, 

mn  <  q  -H*T  ,  VO  <  Z  <  n 
with  equality  holds  for  at  least  two  Z's; 

(iv)  if  Z  (Z)  is  the  smallest  (largest)  Z  such  that  m„  =  q  -Z*x  >  then 

-p  p  &  Z  p  p 

=  Zp,  for  p  =  0,1,..., i-1.  (The  procedure  of  finding  i,  r^'s,  qp's 
can  be  best  illustrated  graphically  by  the  modified  Newton's  diagram 
shown  on  Fig.  A.l.) 
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Step  2:  For  each  0  £  p  <  i,  form  the  polynomial 


<j>  (?.)  =  7 

P  ^Tp+'Y^p) 


a.  z 


(A. 13) 


Step  3:  Calculate  the  zeros  of  ;|>  and  denote  them  by  z  ,  j  =  l,2,...,n 
Calculate  the  nonzero  zeros  of  <f>^,  ].  £  p  £  i,  and  denote  them  by  z^ , 

J  ”  1,2, ... ,n. 

Step  A:  As  jk|  the  n  zeros  of  the  polynomial  P(s,k)  behaves  as 

T 

Zpjk  P  ’  J  =  1>2”-‘>nP  *  1’  =  °»1>2»  •  •  •  >i 


where  n  >1,  for  1  <  p  <  i,  and  >  n  =  n 
P  ~  "  "  jfej  P 


Now  we  can  apply  this  algorithm  to  prove  Proposition  III. A.  Without 
loss  of  generality,  we  only  have  to  prove  the  case  where  nQ  =  and 

M  =  In  .  Note  that 
o 

det[I+kG]  =  1  +  k[ trace  G(s)l 
2 

+  k  [E  principal  minors  of  G(s)  of  order  2] 

+  +  km  det  G 


l:n.dn  +  kSnii(.I?.dn)  +  “’+km‘.n  dij* 


n  d  1  u  *  Lu  "iiv  “  T  it 

ij  i» j  i-l  11  iH  i,j 


det  G] 


"j-j  ^  [  0  +ka1(s)  +k2a2(s)  +  •  ••  +kmam(s)) 

i,j  iJ  i,j 


where  c^(s)  Glt[s],  j  =  l,2,...,m. 


Let  3[  [I  d  ]  =  n.  Since,  by  assumption 
we  have  that  3[ct^(s))  £  n-3j  ,  j-  =  l,2,...,m. 


8dij'3nij  -  3>  Vi,j  =  1,2 
Hence  with  i  defined  in 


Step  I  of  the  algorithm  above, 


4>.(z)  =  zn+a  zn  ^+**»  ,  B  >  3  , 

1  i  p 


where  4>^(z)  is  defined  in  (A. 13). 

O 

Now  we  claim  that  <]>^(z)  has  €+-zcros.  To  see  this,  consider  some 
e  >  0  sufficiently  smalL;  apply  the  Kouth  test  (see  e.g.  [37])  to  the 
polynomial  <j>^(z+e).  Since  B  >  3,  the  first  column  from  the  left  in  the 
Routh  array  contains  some  strictly  negative  numbers,  thus  <J>^(z)  has  some 

.  Ti 

C+-zeros.  Hence  as  k  *►  0>,  det  [I.+kC]  has  zero  behaves  as  z^k  with 


z,  €  c,  and  t,  >  0. 
i  +  i 


Q.E.D. 


ft 

•if 


Proof  of  Proposition  I II. 5: 

(i)  By  definition,  Gu  :=  Gu+dg.  Then,  by  eqn.  (III. A)  (of  Theorem  III.l), 


we  have  that 


"j1! 

Jo 

-  (  (I+D(GK) •F]~1da,dn  (since  D(GK)  =  D(GK)) 


Ay  *  AH  (r)  -  \  [I+D(GK)*F)  5,da*dn  (since  AH  (r)  =>  d  ) 

-yr  J0  -  -  u  ~y0r  u 


-i, 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r+ciAr)  with 

Ar  =  F*AH  (r)  =  F»drt. 

-  ~y0r  -  0 

(ii)  By  definition,  Fy  :=  F(d,+y)  =  Fd,  +Fy  (since  F  is  linear).  Then 


AF*y  =  (F-  )y  =  F*d. 


(A. 14) 


Thus,  following  the  proof  of  Proposition  III. 3,  in  particular,  eqn.  (A. 12) 
we  have  that 


-J1. 


.-1 


Ay  =  -l  D(GK) [I+F*D(GK) ]  da«AF*y  (since  D(GK)  =  D(GK)) 
10  ~  ~  — 
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(by  eqn.  (A. 14)) 


D(GK)[I+F*D(GK)]_iFda*d 


=  -f  D(C«K 

J0  ~~ 

=  -f  D(GK) *F[ I 

j  ..  ~  ~ 


F[I+D(GK),KJ  dwdj.  (since  F  is  linear) 


=  (f  [I+D(GK) •F]-1da-l} *df 
JQ  ..... 


-1, 


where  the  Frechet  derivative  D(GK)  is  evaluated  at  (I+FGK)  (r-KxAr)  with 

Ar  =  -AF*H  r  =  -AF*y  =  -Fd,  and  a  G  [0,1].  Q.E.D. 

.  .yr  ~  ~  f 


Proof  of  Proposition  III. 6; 

By  definition,  Gu  :=  G(u+d  ).  Then  by  eqn.  (III. 4)  (of  Theorem  III.l) 

.  .  g 

we  have  that 


Ay  -  f  [  I+D(GK)  *F ]  1da*[G(u-!-d  )-G(u)] 

jQ  .  ..  .  .  g  .  _ 

(since  AH  (r)  =  C(u+d  )-G(u),  where  u  =  K(I+FGK)  r) 

"yor  -  S'-  . 

=  {(  [I+D(GK)*F]"1da}*{{  DG(u+3d  )d$}*d 

J0  -  ~  8  8 

where  the  Frechet  derivative  D(GK)  is  evaluated  at  (1+FGK)  ^(r+ctAr)  with 

Ar  =  F[G(u+d  )-G(u)),  u  :=  K(I+FGK)"1r,  and  a  €  [0,1].  Q.E.D. 

.  .  g  .  .  .  — ,. 


Proof  of  Proposition  III. 9: 


6T(N,,V)  inf  sup  |N,u-Lu| 

1  1  LGj£  y&V  • 

=  inf  sup  |N  u+L  u-Luj 
LG£  uGV  ~A  - 

=  inf  sup  |N  u-L'uL 
L'SC  vt=V  ~  1 

vt  etf  ,  w  c  u  . 

’  e 


6T(NrV)  , 


Q.E.D. 


Proof  of  Proposition  HI  .10 : 

6  (N,4?/  )  :=  inf  sup  jNu-Luj 
1  ~  1  IjG<£  u£V  '  -  1 

<_  inf  sup  jNu-Luj  (since  Of  C  % .  C  'LL) 
l&L  i«G«£  ~  ~  1  i  z  e 

=  :  6T(N,v2)  .  vrey  .  Q.E.D. 

Proof  of  Proposition  III. 11 : 

Note  that  DN(0)  G  <£.  Hence 

0  <  6  (N,L(0;6))  <  sup  |Nu-DN(0)u|  (A. 15) 

1  -  1  u<=Ct(0;6)  ~  ~ 

By  the  definition  of  Frechet  derivative,  we  know  that  for  any  e  >  0, 

35  >  0  such  that  | Nu-DN(O)  *u|  <  e|u|T>  v|u[tf  £  5.  Hence  as  B  0, 

the  right-hand  side  of  eqn.  (A. 15)  tends  to  zero  and  6^, (N , B^, (0 ; 0) )  ■*  0. 

Q.E.D. 


Proof  of  Proposition  III. 12 : 

Let  Of  C  If,  for  some  L  G  £,  Nu  =  Lu,  Vu  G  7^  then  L  is  a  minimizer  of 

sup  |Nu-Lu|  ,  VT  G^,  and  5  (N,lf)  =  0,  VI  6^.  In  particular,  if  N  G  <£, 
uSV  ~  ~  T  T  " 

then  N  is  a  minimizer  of  sup  |Nu-Lu|  ,  VT  G^F,  W  C  it  ,  hence  6  (N,ir)  =  0, 

uGV  ~  -  1  6  1  ** 

VT  G^,  WC  %  ,  Q.E.D. 

e 


Proof  of  Proposition  III. 13: 

By  assumption,  for  some  T  G  0\ 


6 (N/l/-)  :=  inf  sup  jNu-Luj  =  0  (A. 16) 

T  "  LG^  USV  ~  ~  1 


00  ^ 

Thus  for  this  T,  :there  exists  a  sequence  (L^)^q  C).  such  that 


sup  jflu-L.uj  0,  as  i  ->■  00  (A.  17) 

USV  "  ~1  1 
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or  equivalently,  for  any  >  0,  there  exists  m^  >  0  such  that 

suHNu-L^It  <  ,  yi  >  mjL  (A. 18) 

Now  for  any  £  >  0,  if  we  let  ~  ~  and  choose  the  corresponding  >  0 
such  that  (A. 18)  holds,  then 


^~i"~j^T  ~  B  S.UP  l~iu~Vjui'r  definition  of  the  induced  norm, 
lulf=8  with  8  defined  in  assumption  (a3)) 

1  o'  SUP  |L  u-L  u|  (by  assumption  (a3)) 

15  T 

lit  sup  |Nu-L  u|  +  sup  |Nu-L  u|  ] 

13  uSV  -  T  uEV  ~  -J  T 
1 

—  g  =  e  ,  Vi, j  £  m^  (by  (A. 18)  and  the  choice  of  m^) 


TllUS  ^i^i=0  is  a  Gauchy  sequence  in  (P^»|*|T). 

Note  that  for  each  T  G  Sr1,  (P^af,  |*IT)  is  a  Banach  space  with  the 
usual  induced  norm  since,  by  assumption  (al) ,  P-y  is  a  Banach  space. 
Hence  there  exists  L*  such  that 


?TL.i 


-*  ptl* 
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By  (A.18)i  (A. 19)  and  the  assumption  (a2)  that  sup  |uL  <  °»,  the  right- 

\&V  T 

hand  side  of  eqn.  (A. 20)  tends  to  zero  as  i  <».  Hence  |Nu-L*u|T  =  0, 
Vu  G  ¥  . 


Q.E.D. 


Proof  of  Theorem  III.  14: 


Let  be  a  linear,  causal  operator  such  that  the  linear  operator 
t  LqK C I+FL^,K )  ^  is  well  defined  and  causal.  Then 

Hyrr  "  tyrr  =  GK(I+FGK)“3r  -  LjJtU+FLgK)  -1r 
=  GK(I+FdK)-1r  -  L-K(I+FGK)_1r 

~  ~  "'*'**'  "(l'* 

+  LGK(I+FGK)"lr  -  LGK( I+FL^K) _1r 

"  (?-l‘G)u 

+  LgK(1+FLgK.)_1[(I+FLgK)  -  (I+PGKJlCl+FGKj^r 

(since  F ,  L  ,  K  are  linear  and  u  =  K(I+FG^) _1r) 

=  (9"Vg)u  +  LGK(I+FI.GK)”1F(LG-G)K(I+FGK)”lr,  (since  F  is  linear) 
.  =  (G-L  )u  -  L  K( I+FL„K)  3‘F(G-L_)u,  (since  F,L„,K  are  linear) 

=  (I-L(;^(I+LgKF)  11(G-Lg)u,  (since  F  is  linear) 

“  (I+LgKF)“1(G-Lg)u  (A. 21) 

Thus 
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provided  that  P  (G-L„)u  /  0. 

“'1  "* 

On  letting  L  :  =  LGK(1+FLGK)  \  where  LG  is  defined  in  eqn.  (III. 25), 
we  have,  from  eqn.  (A. 22) 
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FIGURE  CAPTIONS 


Fig.  1.1: 
Fig.  II. 1: 


Fig.  II. 2: 


Fig.  II. 3: 

Fig.  II. 4s 


Fig.  II. 5: 


Fig.  II. 6: 


Fig.  II. 7: 

Fig.  II. 8: 
Fig.  II. 9: 
Fig.  II. 10: 


Nonlinear,  feedback  system  S  under  consideration. 

An  example  realizing  a  nonlinear  input-output  map  using 
nonlinear  feedback  and  a  large  forward-path  gain:  the 
logarithmic  amplifier. 

A  nonlinear,  s Ingle- input ,  single-output,  dynamical  system 
.illustrating  the  generalized  Black  result. 

Characteristics  of  the  nonlinearity  <{>(•)  in  the  nonlinear, 
feedback  system  shown  in  Fig.  II. 2. 

System  outputs  of  the  nonlinear,  feedback  system  shown  in 
Fig.  II. 2  when  the  system  input  is  r(t)  =  sin  lOt  and  the 
compensator  gain  is  k  *»  1,  10,  20  and  40,  respectively. 

Error  signals  of  the  nonlinear,  feedback  system  shown  in 
Fig,  II. 2,  when  the  system  input  is  r(t)  ■  sin  lOt  and  the 
compensator  gains  are  k  =  10,  20  and  40,  respectively. 

The  input  to  the  nonlinearity  <j>(‘)  of  the  nonlinear,  feedback 
system  shown  in  Fig.  11.2,  when  the  system  input  is 
r(t)  =  sin  10 t  and  the  compensator  gains  are  k  =  1,  10,  20 
and  40,  respectively. 

A  nonlinear,  multi-input,  multi-output,  dynamical  system 
illustrating  the  generalized  Black  result. 

Characteristics  of  the  odd  function  v(*). 

Characteristics  of  1+0.2  tanhx,  x  £  0. 

System  output  y^(*)  of  the  nonlinear,  feedback  system  shown 
in  Fig.  II. 7  when  the  system  inputs  are  r^(t)  =  sin  lOt, 

^(t)  =  0.8sinlbt  and  the  compensator  gains  are  k»  1,  10, 

20  and  40,  respectively. 
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Fig.  II. 11: 

Fig.  11.12: 

Fig.  11.13: 

Fig.  11.14: 

Fig.  11.15: 

Fig/  III.l: 

Fig.  III. 2: 
Fig.  III. 3: 

Fig.  III. 4: 

Fig.  III. 5: 


System  output  y^(')  of  the  nonlinear,  feedback  system  shown 
in  Fig.  11.7  when  the  system  inputs  are  r^(t)  =  sin  lOt, 
r^Ct)  =  0.8sinl5t  and  the  compensator  gains  are  k  =  1,  10, 

20  and  40,  respectively. 

Error  signal  e^(*)  of  the  nonlinear ,  feedback  system  shown 
in  Fig.  II. 7  when  the  system  inputs  are  r^(t)  =  sin  lOt, 
r^Ct)  =  0.8sinl5t  and  the  compensator  gains  are  k  =  10,  20, 
and  40,  respectively. 

Error  signal  e2(*)  of  the  nonlinear,  feedback  system  shown 
in  Fig.  II. 7  when  the  system  inputs  are  r^(t)  =  sin  lOt, 
r.(t)  =  0.8sinl5t  and  the  compensator  gains  are  k  =  1.0,  20 
and  40, respectively . 

One.  period  of  the  steady  state  trajectory  of  the  system 
output  y(#)  of  the  nonlinear,  feedback  system  shown  in 
Fig.  11.7  when  r^(t)  =  sin  lOt,  r^Ct)  =  0,8sinl5t  and  k  =  40. 
One  period  of  the  steady  state  trajectory  of  the  input  to 
the  nonlinearity  IK*)  of  the  nonlinear,  feedback  system 
shown  in  Fig.  II. 7  when  r^(t)  =  sin  lOt,  r^(t)  =  0.8sinl5t 
and  k  =  40. 

A  comparison  open-loop  system  for  (comparative)  sensitivity 
analysis . 

The  perturbed  closed-loop  system:  the  plant  G  becomes  G. 

The  perturbed  open-loop  system:  the  plant  G  becomes  G, 
the  precompensator  remains  unchanged. 

The  nonlinear,  multi-loop  feedback  system  for  studying  the 
relation  between  desensitization  and  feedback  structure. 
Nonlinear,  feedback  system  S  subjected  to  additive  external 


disturbances . 


Fig.  III. 6:  Characterizations  of  the  nonlinear  plant  G  and  its  best 

linear  approximation  L*  (in  broken  lines). 

Fig.  III. 7:  Characterizations  of  the  closed-loop  system  H  and  its  best 

~yr 

linear  approximation  (in  broken  lines) . 


Fig.  III. 8:  Outputs  of  the  nonlinear  plant  G,  yQ>  and  the  closed-loop 

system  H  ,  y,  when  the  plant  input  u(t)  =  1.2sinwt  and  the 

closed-loop  system  input  r(t)  =  0.92  sinwt. 

Fig.  A.l:  Modified  Newton's  diagram  for  finding  the  parameters  i, 

T  's,  q  *s. 

P  P 


FOOTNOTES 


In  describing  the  feedback  system  under  consideration,  we  adopted  the 
control  terminology,  i.e.  the  power  stage  of  the  amplifier  is  called 
the  plant;  the  preamplifier  is  called  the  compensator;  etc.  We  trust 
that  this  will  cause  no  great  inconvenience  to  feedback  amplifier 
enthusiasts. 

(2) 

In  the  single-input  single-output,  linear,  time-invariant  case, 
pg  =  gp;  however,  if  any  one  of  these  three  conditions  fails,  one 
must  write  gp.  We  do  so  to  be  self-consistent. 

(3)  »- 

An  operator  N  is  continuous  on  an  extended  space  iff  VT  P,j,N 

is  continuous. 

^If  A  £  CnXn,  the  largest  singular  value  of  A  is  the  square  root  of  the 
largest  eigenvalue  of  A*A,  where  A*  denotes  the  complex  conjugate  of 
A;  it  is  also  the  ^"Induced  norm  of  the  linear  map  A:  <En  -*•  <En. 

^Note  that  for  any  physical  system,  (I+C(ju>)K(ju)F(ju))  ]  ^  +  I  as 

|o>|  •+  «>.  Hence  it  is  impossible  to  fulfill  this  requirement  for  all 

(ilSE, 

^Recall  that  if  for  some  (i,j),  n^(s)  =  0,  then  Sn^ :  * 

^The  results  of  this  section  were  obtained  with  the  collaboration  of 
A.  N.  Payne. 

®  A  function  y( • ) :  -►  Hn  is  said  to  be  asymptotically  T-periodic  iff 

y(«)  3  yT(-)+y0(*),  where  is  a  T-periodic  function  and  yQ(t) 

tends  to  0  as  t  -*■  «. 
n 

€  tlis  said  to  be  Frechet  differentiable  at  x  iff  VT  PTN  is 

Frechet  differentiable  at  x,. 

(10) L  Got  is  said  to  be  continuous  iff  VT  T,  P.rL  is  continuous,  i.e. 

'  ^  ,  ,  lt-lT  ' 

lulT^o 


